-- Logs begin at Sun 2022-02-20 23:57:28 UTC, end at Mon 2022-02-21 01:26:09 UTC. -- Feb 21 00:28:00.368558 dv-cinder-813226-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 00:28:00.377164 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 00:28:00 2022] *** Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: nodename: dv-cinder-813226-6-iscsi Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: machine: x86_64 Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: clock source: unix Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: pcre jit disabled Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: detected number of CPU cores: 4 Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: current working directory: / Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: detected binary path: /usr/bin/uwsgi-core Feb 21 00:28:00.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: your processes number limit is 47680 Feb 21 00:28:00.379904 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: your memory page size is 4096 bytes Feb 21 00:28:00.379904 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: detected max file descriptor number: 2048 Feb 21 00:28:00.379904 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: lock engine: pthread robust mutexes Feb 21 00:28:00.379904 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: thunder lock: enabled Feb 21 00:28:00.379904 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 00:28:00.379904 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 00:28:00.427627 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: Python main interpreter initialized at 0x558e08c619c0 Feb 21 00:28:00.427627 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: python threads support enabled Feb 21 00:28:00.427627 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: your server socket listen backlog is limited to 100 connections Feb 21 00:28:00.427627 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: your mercy for graceful operations on workers is 90 seconds Feb 21 00:28:00.428041 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 00:28:00.428041 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: *** Operational MODE: preforking *** Feb 21 00:28:00.428323 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: *** uWSGI is running in multiple interpreter mode *** Feb 21 00:28:00.428323 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: spawned uWSGI master process (pid: 102196) Feb 21 00:28:00.428566 dv-cinder-813226-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 00:28:00.431546 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: spawned uWSGI worker 1 (pid: 102197, cores: 1) Feb 21 00:28:00.431546 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: spawned uWSGI worker 2 (pid: 102198, cores: 1) Feb 21 00:28:00.431546 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 00:28:02.238618 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:28:02.238618 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: from cryptography.utils import int_from_bytes Feb 21 00:28:02.239304 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:28:02.239304 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: from cryptography.utils import int_from_bytes Feb 21 00:28:02.240251 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:28:02.240251 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: from cryptography.utils import int_from_bytes Feb 21 00:28:02.240807 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:28:02.240807 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: from cryptography.utils import int_from_bytes Feb 21 00:28:04.787354 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 00:28:04.787887 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 00:28:04.787988 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 00:28:04.788336 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 00:28:04.788508 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 00:28:04.789178 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 00:28:04.789263 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 00:28:04.789331 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.789568 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 00:28:04.789740 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.789884 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.789979 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 00:28:04.790156 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 00:28:04.790264 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.790536 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.790681 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.790835 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.790986 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.791170 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.791302 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.791487 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.791618 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.791812 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.791943 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.792033 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.792130 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.792366 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.792539 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.792712 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813226-6-iscsi {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.792844 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.793031 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.793175 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.793322 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.793415 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.793623 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.793720 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.793936 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.794029 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813226-6-iscsi {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.794235 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.794334 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.794558 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.794649 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.794850 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.794950 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.795167 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.795342 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.795738 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.795882 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.795996 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.796101 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.796205 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.796358 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.796594 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.796787 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.796873 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.796998 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.797201 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.797292 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.797514 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.797620 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.797853 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.797951 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.798172 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.798271 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.798490 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.798581 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.798809 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.798899 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813226-6-iscsi {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.799123 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.799221 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.799434 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.799527 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.799748 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.799833 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.800169 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813226-6-iscsi {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.800356 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.800495 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.800594 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.800813 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.800942 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.801128 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.801230 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.801501 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.801592 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.801809 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.801897 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.802135 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.802227 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.802451 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.802540 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.802769 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.802856 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.803086 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.803181 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.803386 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.803479 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.803693 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.803786 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.803999 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.804096 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.804315 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.804435 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.804644 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.804732 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.804946 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.805042 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.805194 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.805286 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.805499 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.805587 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.805819 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.805907 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.806137 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.806231 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.806420 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.806505 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.806697 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.806783 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.806944 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.807032 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.807257 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.807354 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.807575 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.807674 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.807880 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.807966 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.808139 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.808233 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.808483 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.808586 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.808794 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.808889 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.809098 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.809191 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.809403 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.809491 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.809708 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.809793 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.810013 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.810140 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.810319 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.810404 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.810629 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.810715 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.810939 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.811026 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.811242 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.811326 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.811559 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.811652 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.811876 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.811962 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.812183 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.812269 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.812514 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.812615 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.812837 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.812922 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.813153 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.813279 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.813458 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.813553 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.813773 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.813858 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.814088 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.814180 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.814394 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.814488 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.814698 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.814792 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.815003 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.815089 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.815321 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.815415 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.815632 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.815723 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.815938 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.816023 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.816185 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.816280 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.816582 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.816671 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.816888 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.816972 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.817229 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.817326 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.817482 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.817568 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.817786 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.817872 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.818097 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.818191 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.818404 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.818489 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.818709 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.818795 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.819014 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.819101 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.819319 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.819413 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.819623 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.819707 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.819925 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.820019 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.820228 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.820313 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.820556 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.820661 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.820862 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.820955 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.821166 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.821259 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.821471 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.821564 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.821781 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.821867 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.822083 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.822170 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.822391 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.822518 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.822692 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.822792 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.822992 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.823091 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.823310 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.823532 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.823670 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.823810 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.823947 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.824079 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.824208 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.824347 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.824520 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.824626 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.824824 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.824911 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.825136 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.825228 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.825439 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.825532 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.825745 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.825831 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.826054 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.826147 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.826356 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.826442 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.826660 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.826747 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.826967 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.827060 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.827269 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.827360 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.827574 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.827662 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.827874 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.827961 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.828174 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.828269 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.828498 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.828588 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.828803 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.828898 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.829102 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.829187 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.829406 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.829497 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.829703 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.829789 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.830009 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.830138 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.830315 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.830402 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.830617 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.830711 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.830918 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.831002 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.831217 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.831314 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.831531 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.831619 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.831845 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.831981 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.832157 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.832257 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.832493 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.832593 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.832869 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:28:04.832959 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.833196 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.833291 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.833522 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.833630 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.833838 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.833929 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.834148 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.834242 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.834461 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.834549 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.834784 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.834869 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.835094 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.835181 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.835399 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.835484 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.835706 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.835794 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.836020 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.836108 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.836333 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.836466 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.836675 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.836768 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.836990 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.837078 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.837300 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.837406 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.837617 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.837704 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.837926 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.838014 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.838239 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.838325 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.838559 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.838645 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.838874 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.838960 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.839181 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.839275 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.839497 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.839583 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.839829 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.839923 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.840140 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.840236 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.840476 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.840584 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.840801 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.840895 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.841110 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.841197 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.841419 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.841514 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.841727 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.841813 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.842048 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.842133 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.842374 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.842468 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.842686 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.842771 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.843000 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.843090 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.843308 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.843401 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.843621 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.843714 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.843928 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.844014 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.844233 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.844320 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.844566 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.844654 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.844886 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.844972 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.845195 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.845282 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.845506 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.845593 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.845814 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.845909 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.846127 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.846215 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.846442 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.846530 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.846750 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.846843 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.847058 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.847145 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.847359 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.847444 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.847659 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.847753 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.847960 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.848053 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.848288 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.848382 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.848615 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.848715 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.848930 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.849016 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.849255 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.849340 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.849560 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.849654 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.849874 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.849966 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.850175 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.850298 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.850481 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.850576 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.850784 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.850870 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.851092 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.851178 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.851392 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.851487 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.851697 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.851784 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.852001 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.852087 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.852302 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.852410 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.852630 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.852714 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.852936 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.853023 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.853236 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.853324 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.853540 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.853632 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.853843 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.853937 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.854142 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.854230 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.854451 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.854538 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.854756 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.854849 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.855061 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.855148 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.855365 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.855451 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.855670 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.855765 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.855977 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.856290 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.856485 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.856629 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.856804 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.856939 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.857115 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.857282 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.857445 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.857576 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.857771 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.857887 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.858071 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.858222 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.858389 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.858554 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.858708 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.858860 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.859019 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.859183 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.859316 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.859510 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.859603 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.859826 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.859912 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.860131 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.860216 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.860468 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.860604 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.860778 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.860887 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.861082 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.861174 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.861382 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.861477 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.861681 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.861767 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.861978 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.862064 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.862275 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.862361 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.862576 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.862661 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.862880 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.862964 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.863180 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.863268 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.863479 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.863565 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.863780 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.863894 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.864141 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.864237 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.864470 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.864560 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.864778 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.864867 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.865123 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.865219 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.865439 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.865526 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.865753 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.865848 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.866062 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.866158 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.866377 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.866463 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.866679 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.866778 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.866985 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.867071 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.867290 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.867383 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.867594 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.867690 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.867906 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.867992 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.868210 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.868303 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.868544 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.868646 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.868850 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.868936 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.869164 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.869248 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.869467 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.869566 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.869780 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.869868 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.870076 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.870161 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.870385 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.870480 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.870706 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.870799 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.874880 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875000 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875101 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875188 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875270 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875351 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875439 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875520 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875609 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875691 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875770 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875850 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.875937 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876019 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876107 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876189 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876275 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876356 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876473 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876634 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876717 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876842 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.876966 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877057 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877140 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877228 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877308 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877435 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877559 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877657 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877745 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877865 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.877987 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878085 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878202 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878307 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878393 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878483 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878565 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878644 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878751 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878851 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.878951 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879042 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879123 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879202 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879281 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879360 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879451 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879533 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879611 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879702 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879816 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.879934 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880044 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880153 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880255 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880255 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880508 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880657 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880779 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880870 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880957 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.880957 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881075 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881139 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881226 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881307 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881391 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881471 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881550 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881754 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.881887 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.882045 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.882165 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.882372 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.882502 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.882680 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.882810 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.882974 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.883104 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.883287 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.883419 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.883553 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.883648 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.883883 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.884065 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.884165 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.884255 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.884510 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.884681 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.884775 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.884856 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.885098 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.885248 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.885366 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.885461 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.885733 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.885865 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.886040 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.886183 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.886311 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.886405 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.886642 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.886772 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.886961 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.887104 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.887249 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.887344 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.887562 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.887653 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.887870 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.887971 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.888173 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.888264 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.888513 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.888605 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.888822 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.888912 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.889128 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.889229 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.889432 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.889524 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.889741 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.889832 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.890046 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.890136 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.890356 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.890446 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.890667 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.890806 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.890971 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.891060 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.891272 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.891372 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.891577 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.891677 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.891877 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.891968 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.892182 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.892285 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.892517 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.892620 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.892828 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.893071 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.893158 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.893401 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.893497 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.893711 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.893805 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.894024 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.894285 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.894381 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.894630 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.894724 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.894952 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.895072 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.895327 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.895432 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.895653 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.895739 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.895956 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.896050 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.896263 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.896349 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.896595 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.896684 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.896898 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.896991 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.897205 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.897295 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.897506 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.897675 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.897808 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.897896 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.898108 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.898196 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.898411 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.898511 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.898709 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.898796 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.899007 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.899093 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.899305 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.899392 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.899603 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.899699 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.899914 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.900001 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.900212 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.900299 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.900542 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.900644 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.900844 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.900932 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.901159 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.901252 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.901459 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.901561 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.901757 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.901846 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.902057 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.902145 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.902354 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.902448 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.902677 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.902761 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.902979 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.903066 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.903286 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.903370 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.903593 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.903688 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.903940 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.904025 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.904243 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.904339 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.904568 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.904674 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.904887 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.905022 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.905191 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.905304 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.905488 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.905589 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.905790 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.905877 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.906098 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.906186 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.906409 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.906626 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.906712 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.906944 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.907037 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.907258 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.907364 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.907574 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.907664 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.907877 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.907968 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.908176 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.908272 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.908509 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.908599 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.908810 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.908895 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.909119 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.909216 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.909422 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.909514 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.909721 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.909806 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.910019 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.910127 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.910323 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.910408 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.910622 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.910727 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.910943 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.911040 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.911246 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.911332 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.911543 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.911636 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.911853 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.911943 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.912152 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.912240 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.912473 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.912561 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.912775 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.912862 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.913077 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.913162 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.913382 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.913485 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.913677 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.913762 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.914290 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.914407 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.914597 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.914693 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.914893 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.914978 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.915195 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.915353 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.915497 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.915641 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.915774 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.915908 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.916069 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.916202 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.916369 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.916508 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.916711 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.916800 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.917023 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.917107 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.917321 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.917407 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.917626 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.917717 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.917923 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.918007 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.918224 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.918321 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.918523 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.918609 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.918827 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.918914 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.919125 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.919220 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.919427 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.919528 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.919725 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.919812 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.920022 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.920117 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.920321 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.920428 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.920656 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.920753 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.920958 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.921094 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.921258 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.921345 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.921559 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.921654 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.921858 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.921952 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.922182 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.922267 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.922491 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.922592 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.922796 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.922886 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.923105 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.923191 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.923412 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.923507 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.923730 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.923822 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.924039 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.924127 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.924349 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.924468 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.924703 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.924790 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.925006 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.925092 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.925323 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.925411 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.925630 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.925717 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.925942 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.926028 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.926242 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.926338 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.926592 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.926680 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.926913 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.927015 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.927260 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.927337 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.927571 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.927647 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.927879 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.927962 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.928276 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.928365 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.928607 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.928704 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.928836 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.928937 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.929145 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.929241 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.929456 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.929544 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.929766 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.929861 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.930073 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.930159 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.930383 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.930469 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.930690 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.930784 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.930998 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.931085 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.931309 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.931404 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.931616 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.931712 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.931924 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.932012 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.932228 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.932317 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.932562 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.932652 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.932871 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.932960 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.933172 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.933260 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.933488 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.933575 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.933796 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.933938 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.934098 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.934188 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.934405 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.934534 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.934708 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.934804 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.935014 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.935101 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.935316 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.935405 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.935637 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.935761 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.935952 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.936051 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.936264 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.936351 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.936606 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.936693 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.936916 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.937014 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.937265 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.937350 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.937580 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.937666 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.937898 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.937993 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.938203 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.938288 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.938558 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.938651 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.938873 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.938969 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.939196 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.939282 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.939503 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.939587 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.939807 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.939894 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.940109 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.940227 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.940438 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.940574 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.940765 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.940894 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.941068 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.941218 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.941371 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.941530 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.941671 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.941842 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.942021 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.942185 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.942336 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.942518 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.942657 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.942831 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.943066 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.943153 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.943375 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.943471 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.943679 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.943772 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.944050 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.944136 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.944377 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.944513 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.944781 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.944869 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.945102 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.945194 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.945420 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.945517 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.945741 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.945838 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.946045 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.946133 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.946360 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.946455 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.946667 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.946754 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.946985 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.947071 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.947307 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.947405 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.947615 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.947711 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.947928 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.948016 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.948230 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.948317 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.948580 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.948680 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.948899 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.948986 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.949211 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.949300 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.949530 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.949620 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.949849 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.949936 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.950181 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.950269 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.950510 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.950598 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.950830 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.950917 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.951155 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.951241 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.951460 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.951576 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.951764 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.951907 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.952072 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.952224 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.952378 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.952578 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.952705 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.952912 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.953028 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.953224 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.953319 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.953538 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.953625 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.953855 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.953944 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.954170 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.954265 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.954484 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.954572 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.954796 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.954888 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.955115 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.955201 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.955414 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.955500 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.955733 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.955827 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.956043 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.956135 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.956350 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.956454 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.956684 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.956785 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.957012 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.957303 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.957390 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.957678 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.957765 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.958003 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.958096 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.958307 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.958394 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.958616 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.958728 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.958924 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.959022 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.959257 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.959359 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.959557 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.959658 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.959865 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.959957 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.960175 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.960268 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.960506 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.960615 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.960835 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.960920 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.961152 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.961237 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.961479 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.961634 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.961794 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.961930 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.962110 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.962245 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.962424 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.962565 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.962704 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.962847 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.963009 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.963151 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.963317 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.963452 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.963620 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.963755 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.963923 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.964058 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.964227 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.964363 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.964561 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.964706 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.964848 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.964988 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.965151 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.965286 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.965450 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.965586 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.965769 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.965902 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.966083 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.966217 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.966384 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.966518 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.966690 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.966844 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.966979 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.967118 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.967278 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.967413 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.967579 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.967722 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.967913 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.968054 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.968210 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.968343 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.968545 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.968709 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.968851 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.968986 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.969153 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.969296 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.969500 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.969647 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.969805 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.969937 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.970126 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.970261 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.970442 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.970578 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.970758 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.970893 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.971071 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.971214 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.971387 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.971526 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.971703 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.971802 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.972016 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.972104 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.972329 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.972466 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.972662 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.972757 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.972976 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.973063 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.973316 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.973406 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.973629 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.973724 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.973946 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.974154 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.974263 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.974478 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.974588 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.974790 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.974910 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.975100 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.975238 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.975411 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.975719 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.975805 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.976031 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.976133 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.976343 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.976463 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.976688 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.976777 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.976995 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.977084 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.977302 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.977396 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.977622 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.977709 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.977936 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.978023 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.978252 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.978339 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.978569 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.978663 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.978879 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.978974 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.979194 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.979282 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.979505 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.979605 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.979820 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.979907 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.980156 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.980241 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.980488 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.980592 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.980794 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.980884 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.981106 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.981193 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.981434 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.981536 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.981751 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.981838 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.982065 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.982159 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.982375 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.982464 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.982688 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.982799 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.983002 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.983088 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.983306 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.983448 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.983613 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.983709 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.983924 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.984023 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.984234 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.984320 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.984575 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.984672 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.984893 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.984990 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.985207 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.985296 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.985516 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.985604 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.985826 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.985923 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.986139 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.986230 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.986476 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.986656 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.986799 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.986969 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.987118 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.987295 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.987427 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.987615 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.987743 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.987933 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.988246 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.988333 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.988589 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.988692 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.988960 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.989056 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.989263 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.989352 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.989563 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.989652 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.989870 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.989958 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.990174 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.990261 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.990476 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.990573 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.990796 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.990891 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.991101 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.991189 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.991402 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.991505 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.991712 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.991833 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.992013 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.992099 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.992339 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.992569 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.992666 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.992922 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.993010 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.993238 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.993326 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.993560 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.993657 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.993881 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.994091 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.994185 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.994443 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.994532 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.994764 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.994850 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.995085 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.995204 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.995481 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.995582 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.995674 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.995764 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.995985 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.996074 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.996291 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.996422 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.996620 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.996721 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.996926 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.997022 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.997230 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.997324 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.997531 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.997619 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.997837 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.997934 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.998139 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.998226 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.998449 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.998535 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.998752 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.998847 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.999053 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.999140 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.999351 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.999445 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.999655 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.999754 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:04.999954 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.000048 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.000256 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.000352 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.000583 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.000675 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.000883 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.000979 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.001192 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.001280 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.001491 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.001580 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.001796 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.001882 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.002095 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.002189 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.002397 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.002493 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.002696 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.002787 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.003001 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.003088 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.003309 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.003397 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.003614 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.003703 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.003931 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.004018 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.004239 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.004328 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.004622 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.004712 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.004941 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.005044 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.005260 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.005348 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.005567 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.005654 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.005874 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.006012 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.006194 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.006291 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.006506 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.006594 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.006832 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.007026 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.007146 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.007354 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.007442 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.007671 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.007790 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.007999 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.008095 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.008324 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.008654 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.008758 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.008957 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.009046 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.009258 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.009354 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.009579 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.009686 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.009886 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.009996 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.010187 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.010279 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.010495 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.010584 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.010800 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.010889 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.011109 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.011197 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.011415 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.011513 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.011721 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.011810 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.012028 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.012123 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.012334 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.012467 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.012666 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.012754 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.012969 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.013057 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.013279 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.013375 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.013593 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.013680 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.013905 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.013993 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.014217 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.014313 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.014530 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.014617 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.014841 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.014926 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.015151 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.015248 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.015460 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.015556 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.015764 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.015863 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.016072 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.016162 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.016410 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.016517 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.016734 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.016820 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.017041 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.017129 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.017347 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.017452 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.017660 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.017754 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.017983 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.018077 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.018318 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.018410 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.018637 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.018734 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.018952 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.019046 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.019268 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.019361 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.019588 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.019685 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.019897 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.019991 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.020243 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.020340 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.020581 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.020680 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.020909 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.021002 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.021243 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.021332 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.021569 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.021657 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.021888 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.021982 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.022192 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.022281 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.022493 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.022602 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.022796 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.022890 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.023103 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.023199 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.023428 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.023527 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.023757 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.023844 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.024064 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.024158 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.024375 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.024523 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.024706 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.024793 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.025026 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.025126 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.025333 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.025420 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.025649 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.025743 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.025967 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.026063 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.026280 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.026403 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.026586 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.026672 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.026904 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.026991 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.027207 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.027293 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.027515 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.027602 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.027823 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.027913 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.028131 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.028217 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.028466 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.028570 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.028776 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.028865 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.029090 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.029175 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.029407 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.029502 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.029709 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.029796 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.030023 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.030110 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.030337 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.030430 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.030654 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.030741 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.030967 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.031062 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.031275 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.031370 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.031598 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.031684 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.031908 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.031996 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.032246 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.032346 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.032548 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.032645 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.032857 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.032950 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.033165 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.033254 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.033477 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.033565 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.033788 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.033874 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.034116 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.034214 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.034424 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.034514 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.034738 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.034835 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.035055 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.035148 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.035370 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.035457 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.035723 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.035852 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.036066 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.036160 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.036410 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.036546 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.036747 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.036846 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.037056 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.037145 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.037404 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.037507 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.037591 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 00:28:05.037728 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.038058 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.038374 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.038689 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.039312 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:28:05.039559 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 00:28:05.060985 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_db.sqlalchemy.engines [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:28:05.062259 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG oslo_db.sqlalchemy.engines [None req-e3677938-b322-4b76-bf17-e017e15910af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:28:05.122772 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.context [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ada545b6-27f6-4ebc-a627-b9fe2dee4e97(cell1) {{(pid=102198) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 00:28:05.125052 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.context [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ada545b6-27f6-4ebc-a627-b9fe2dee4e97(cell1) {{(pid=102197) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 00:28:05.127005 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:28:05.128607 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:28:05.129288 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG oslo_concurrency.lockutils [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:28:05.129439 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:28:05.130948 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG oslo_concurrency.lockutils [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:28:05.131416 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:28:05.131769 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG oslo_concurrency.lockutils [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:28:05.133748 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG oslo_concurrency.lockutils [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:28:05.141772 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_db.sqlalchemy.engines [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:28:05.144371 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_db.sqlalchemy.engines [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:28:05.148044 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG oslo_db.sqlalchemy.engines [None req-e3677938-b322-4b76-bf17-e017e15910af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:28:05.150853 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG oslo_db.sqlalchemy.engines [None req-e3677938-b322-4b76-bf17-e017e15910af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:28:05.305817 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_db.sqlalchemy.engines [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:28:05.308536 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG oslo_db.sqlalchemy.engines [None req-e3677938-b322-4b76-bf17-e017e15910af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:28:05.640110 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: WARNING keystonemiddleware.auth_token [None req-e3677938-b322-4b76-bf17-e017e15910af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 00:28:05.646762 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: WARNING keystonemiddleware.auth_token [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 00:28:05.648432 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: WARNING keystonemiddleware.auth_token [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 00:28:05.655065 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: WARNING keystonemiddleware.auth_token [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 00:28:05.981977 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: WARNING keystonemiddleware.auth_token [None req-e3677938-b322-4b76-bf17-e017e15910af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 00:28:05.987201 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: WARNING keystonemiddleware.auth_token [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 00:28:05.991398 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: WARNING keystonemiddleware.auth_token [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 00:28:05.992362 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558e08c619c0 pid: 102197 (default app) Feb 21 00:28:05.994440 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:28:05.995625 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-e3677938-b322-4b76-bf17-e017e15910af None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Feb 21 00:28:05.996013 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Mon Feb 21 00:28:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:28:05.996811 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: WARNING keystonemiddleware.auth_token [None req-5d85ab46-d449-490c-8699-ed0516adfad2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 00:28:06.001892 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558e08c619c0 pid: 102198 (default app) Feb 21 00:29:27.086646 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:27.087672 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-e3677938-b322-4b76-bf17-e017e15910af None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Feb 21 00:29:27.088015 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:27.512213 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-bf10cdee-cda2-4bae-b68a-c97cde6e8ada admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:27.541895 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-bf10cdee-cda2-4bae-b68a-c97cde6e8ada admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447086 Feb 21 00:29:27.542391 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1291 bytes} [Mon Feb 21 00:29:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:29:29.880050 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-e3677938-b322-4b76-bf17-e017e15910af None None] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:29.881089 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-e3677938-b322-4b76-bf17-e017e15910af None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Feb 21 00:29:29.881460 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:29.941739 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-f6f4ab15-73bb-4b4f-b183-ed02b25ba2b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1"}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:29.959811 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:29:29.959811 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: warnings.warn(msg) Feb 21 00:29:29.989205 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-f6f4ab15-73bb-4b4f-b183-ed02b25ba2b6 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101647 Feb 21 00:29:29.989948 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:29:30.208843 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-502f0042-ba8a-4294-9299-3837cadfa8be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:30.211174 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:29:30.211174 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: warnings.warn(msg) Feb 21 00:29:30.265758 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-502f0042-ba8a-4294-9299-3837cadfa8be admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265580 Feb 21 00:29:30.275778 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1335 bytes} [Mon Feb 21 00:29:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:29:32.605090 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-f6f4ab15-73bb-4b4f-b183-ed02b25ba2b6 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:32.606098 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-f6f4ab15-73bb-4b4f-b183-ed02b25ba2b6 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Feb 21 00:29:32.606492 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:32.729201 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-f6f923b7-a456-4a23-a786-a996aecaca92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:32.748502 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:29:32.748502 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: warnings.warn(msg) Feb 21 00:29:32.771488 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-f6f923b7-a456-4a23-a786-a996aecaca92 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157753 Feb 21 00:29:32.772896 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:29:32.784536 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-3087645f-97c7-42d4-8295-01957c92349d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:32.787554 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:29:32.787554 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: warnings.warn(msg) Feb 21 00:29:32.824846 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-3087645f-97c7-42d4-8295-01957c92349d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044300 Feb 21 00:29:32.825435 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1335 bytes} [Mon Feb 21 00:29:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:29:35.146803 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-f6f923b7-a456-4a23-a786-a996aecaca92 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:35.148624 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-f6f923b7-a456-4a23-a786-a996aecaca92 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002198 Feb 21 00:29:35.149306 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:35.210304 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c77def9f-faa8-4c2f-a123-3853f0d77a97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "id": "d2", "ram": 1024, "name": "ds1G"}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:35.233723 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c77def9f-faa8-4c2f-a123-3853f0d77a97 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077945 Feb 21 00:29:35.234298 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 00:29:35.246092 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-ec526ea4-45f5-4353-8321-2d7a6edd20df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:35.270579 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-ec526ea4-45f5-4353-8321-2d7a6edd20df admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028085 Feb 21 00:29:35.271134 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1335 bytes} [Mon Feb 21 00:29:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:29:37.645015 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c77def9f-faa8-4c2f-a123-3853f0d77a97 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:37.646184 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c77def9f-faa8-4c2f-a123-3853f0d77a97 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Feb 21 00:29:37.646701 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:37.721999 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-da8fdb0d-2b09-4456-8471-4a1ed86e902c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "id": "d3", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:37.740108 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-da8fdb0d-2b09-4456-8471-4a1ed86e902c admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087376 Feb 21 00:29:37.740892 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:29:37.752293 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-4dbe7fe5-50b8-4180-ac55-43491c34d14d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:37.774610 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-4dbe7fe5-50b8-4180-ac55-43491c34d14d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026008 Feb 21 00:29:37.775156 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1335 bytes} [Mon Feb 21 00:29:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:29:40.101275 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-da8fdb0d-2b09-4456-8471-4a1ed86e902c admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:40.102283 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-da8fdb0d-2b09-4456-8471-4a1ed86e902c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Feb 21 00:29:40.102665 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:40.164900 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-98ab4dbc-90e3-4f84-9567-211d7c14deb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "ram": 4096, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:40.182929 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-98ab4dbc-90e3-4f84-9567-211d7c14deb7 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074626 Feb 21 00:29:40.183464 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:29:40.195263 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-5d23df20-4c84-47dd-b95e-6340633e16f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:40.217598 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-5d23df20-4c84-47dd-b95e-6340633e16f7 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026147 Feb 21 00:29:40.218648 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1335 bytes} [Mon Feb 21 00:29:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:29:42.560563 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-98ab4dbc-90e3-4f84-9567-211d7c14deb7 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:42.561709 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-98ab4dbc-90e3-4f84-9567-211d7c14deb7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Feb 21 00:29:42.562287 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:42.620404 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-e782d3c3-dbe8-46c1-8bc2-f84f417637d3 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:42.644176 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-e782d3c3-dbe8-46c1-8bc2-f84f417637d3 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076018 Feb 21 00:29:42.644753 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1291 bytes} [Mon Feb 21 00:29:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:29:45.033652 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-98ab4dbc-90e3-4f84-9567-211d7c14deb7 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:45.034995 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-98ab4dbc-90e3-4f84-9567-211d7c14deb7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Feb 21 00:29:45.035770 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:45.097064 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-68a4e4b4-da62-4098-a35a-75b515a20b85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:45.121618 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-68a4e4b4-da62-4098-a35a-75b515a20b85 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079575 Feb 21 00:29:45.122365 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:29:45.134891 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-fa3e349b-946d-4874-8f11-b723ade7d6e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:45.163233 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-fa3e349b-946d-4874-8f11-b723ade7d6e3 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032236 Feb 21 00:29:45.164218 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1332 bytes} [Mon Feb 21 00:29:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:29:47.551145 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-68a4e4b4-da62-4098-a35a-75b515a20b85 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:47.552486 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-68a4e4b4-da62-4098-a35a-75b515a20b85 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001931 Feb 21 00:29:47.553024 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:47.623771 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-4c98f367-1ce0-493c-aff4-edc2cadc4010 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:47.647542 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-4c98f367-1ce0-493c-aff4-edc2cadc4010 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088312 Feb 21 00:29:47.648343 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:29:47.662589 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-5c4630df-4053-4436-ad0d-6dedfc7582ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:47.691645 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-5c4630df-4053-4436-ad0d-6dedfc7582ff admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034523 Feb 21 00:29:47.696416 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1332 bytes} [Mon Feb 21 00:29:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:29:50.051158 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-4c98f367-1ce0-493c-aff4-edc2cadc4010 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:50.052181 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-4c98f367-1ce0-493c-aff4-edc2cadc4010 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Feb 21 00:29:50.052598 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:50.112698 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-46b17485-76e8-404d-87a4-41082d1b1fb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "disk": 40, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:50.132326 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-46b17485-76e8-404d-87a4-41082d1b1fb2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073562 Feb 21 00:29:50.132927 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 00:29:50.144705 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-6437b4f6-ac98-4256-a6df-17dfd83e48b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:50.169085 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-6437b4f6-ac98-4256-a6df-17dfd83e48b9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027999 Feb 21 00:29:50.169632 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1332 bytes} [Mon Feb 21 00:29:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:29:52.494501 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-46b17485-76e8-404d-87a4-41082d1b1fb2 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:52.495508 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-46b17485-76e8-404d-87a4-41082d1b1fb2 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Feb 21 00:29:52.495917 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:52.560533 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-1ce4cde8-e2d2-4d77-8124-1c02d30eb59d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:52.580041 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-1ce4cde8-e2d2-4d77-8124-1c02d30eb59d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078242 Feb 21 00:29:52.581222 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:29:52.592704 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-f53fab62-0dc6-484a-bc0b-e193fb0631d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:52.615533 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-f53fab62-0dc6-484a-bc0b-e193fb0631d9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026527 Feb 21 00:29:52.616116 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1332 bytes} [Mon Feb 21 00:29:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:29:54.960024 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-1ce4cde8-e2d2-4d77-8124-1c02d30eb59d admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:29:54.961060 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-1ce4cde8-e2d2-4d77-8124-1c02d30eb59d admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Feb 21 00:29:54.968467 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:29:55.018832 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-806e3b93-13dc-4cf2-8757-b3482597339d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "vcpus": 8, "id": "5", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:55.038885 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-806e3b93-13dc-4cf2-8757-b3482597339d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071481 Feb 21 00:29:55.039602 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1282 bytes} [Mon Feb 21 00:29:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:29:55.051390 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-79ae0955-2530-4ae9-a3b8-4a5c4e9289f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:29:55.079523 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-79ae0955-2530-4ae9-a3b8-4a5c4e9289f0 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031881 Feb 21 00:29:55.080380 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1332 bytes} [Mon Feb 21 00:29:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:30:17.266548 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-806e3b93-13dc-4cf2-8757-b3482597339d admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:17.268128 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-806e3b93-13dc-4cf2-8757-b3482597339d admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Feb 21 00:30:17.268772 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:30:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:17.335589 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-7ff9861f-baca-48ea-aac1-3df52709f41e admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:17.355020 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-7ff9861f-baca-48ea-aac1-3df52709f41e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080328 Feb 21 00:30:17.355556 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1291 bytes} [Mon Feb 21 00:30:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:30:18.743771 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-806e3b93-13dc-4cf2-8757-b3482597339d admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:18.744808 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-806e3b93-13dc-4cf2-8757-b3482597339d admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Feb 21 00:30:18.745210 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:18.969533 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-bff0852b-58a3-4c74-9d8c-97d44a252ccb admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:18.975187 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.wsgi [None req-bff0852b-58a3-4c74-9d8c-97d44a252ccb admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 00:30:18.975751 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-bff0852b-58a3-4c74-9d8c-97d44a252ccb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:30:18.976569 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-bff0852b-58a3-4c74-9d8c-97d44a252ccb admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064723 Feb 21 00:30:18.977085 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Mon Feb 21 00:30:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 00:30:18.987676 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-20d90c0c-ac87-4db7-aad5-b75c07eb1d6f admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:19.008377 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-20d90c0c-ac87-4db7-aad5-b75c07eb1d6f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025367 Feb 21 00:30:19.008955 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Mon Feb 21 00:30:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:30:19.018950 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-0a669ec7-4086-4fa6-89f7-09d0147df540 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:19.040523 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-0a669ec7-4086-4fa6-89f7-09d0147df540 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025129 Feb 21 00:30:19.041048 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Mon Feb 21 00:30:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:30:19.050912 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-1ab66acb-6df5-4c0d-9087-4990e24f1f05 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:19.057425 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.wsgi [None req-1ab66acb-6df5-4c0d-9087-4990e24f1f05 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 00:30:19.058030 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-1ab66acb-6df5-4c0d-9087-4990e24f1f05 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:30:19.058826 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-1ab66acb-6df5-4c0d-9087-4990e24f1f05 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011805 Feb 21 00:30:19.059336 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Mon Feb 21 00:30:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 00:30:20.322678 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-0a669ec7-4086-4fa6-89f7-09d0147df540 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:20.323679 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-0a669ec7-4086-4fa6-89f7-09d0147df540 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Feb 21 00:30:20.324061 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:30:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:20.523352 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-fd71a5a9-67bc-4c8f-be07-bb39c93005fc admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:20.529075 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.wsgi [None req-fd71a5a9-67bc-4c8f-be07-bb39c93005fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 00:30:20.529565 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-fd71a5a9-67bc-4c8f-be07-bb39c93005fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:30:20.530383 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-fd71a5a9-67bc-4c8f-be07-bb39c93005fc admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071108 Feb 21 00:30:20.530906 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Mon Feb 21 00:30:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 00:30:20.541090 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-619969e9-e81f-40a7-9726-1b3b4dbcdece admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:20.555028 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-619969e9-e81f-40a7-9726-1b3b4dbcdece admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017593 Feb 21 00:30:20.555546 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Mon Feb 21 00:30:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:30:20.565256 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-f71d78be-2692-4caa-a346-e8765f10e8fd admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:20.579664 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-f71d78be-2692-4caa-a346-e8765f10e8fd admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018081 Feb 21 00:30:20.580196 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Mon Feb 21 00:30:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:30:20.594824 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-0a83c764-5969-4158-bafe-e143e801cb71 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:20.603082 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.wsgi [None req-0a83c764-5969-4158-bafe-e143e801cb71 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 00:30:20.603860 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-0a83c764-5969-4158-bafe-e143e801cb71 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:30:20.604989 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-0a83c764-5969-4158-bafe-e143e801cb71 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015560 Feb 21 00:30:20.605599 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Mon Feb 21 00:30:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 00:30:21.880225 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-f71d78be-2692-4caa-a346-e8765f10e8fd admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:21.881833 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-f71d78be-2692-4caa-a346-e8765f10e8fd admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002311 Feb 21 00:30:21.882427 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:22.086620 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-8c215d22-40f5-42fb-9632-94e06d695ffa admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:22.095306 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.wsgi [None req-8c215d22-40f5-42fb-9632-94e06d695ffa admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 00:30:22.096126 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-8c215d22-40f5-42fb-9632-94e06d695ffa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:30:22.097471 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-8c215d22-40f5-42fb-9632-94e06d695ffa admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.078982 Feb 21 00:30:22.098544 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Mon Feb 21 00:30:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 00:30:22.114882 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-8f540c37-bb5e-4bb2-a4bb-41c1176f1334 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:22.129182 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-8f540c37-bb5e-4bb2-a4bb-41c1176f1334 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019143 Feb 21 00:30:22.129746 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Mon Feb 21 00:30:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:30:22.141416 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:22.155015 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018881 Feb 21 00:30:22.155527 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Mon Feb 21 00:30:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:30:22.165272 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-bf34c0f8-5330-4272-b1ce-1fdc35b15261 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:22.171287 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.wsgi [None req-bf34c0f8-5330-4272-b1ce-1fdc35b15261 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 00:30:22.171835 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-bf34c0f8-5330-4272-b1ce-1fdc35b15261 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:30:22.172636 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-bf34c0f8-5330-4272-b1ce-1fdc35b15261 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011300 Feb 21 00:30:22.173109 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Mon Feb 21 00:30:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 00:30:23.447788 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:23.448816 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Feb 21 00:30:23.449206 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:30:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:23.670094 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-9d63d8f2-8c61-4356-8829-83edb96533d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:30:23.690709 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-9d63d8f2-8c61-4356-8829-83edb96533d4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086015 Feb 21 00:30:23.691248 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Mon Feb 21 00:30:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:30:24.962107 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:24.963136 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Feb 21 00:30:24.963494 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:25.155482 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-5fd96451-b9d8-4467-ac6a-d5599c79ee8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:30:25.177682 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-5fd96451-b9d8-4467-ac6a-d5599c79ee8e admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.079210 Feb 21 00:30:25.178121 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Mon Feb 21 00:30:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:30:26.452081 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:26.453119 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Feb 21 00:30:26.453509 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:30:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:26.647664 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-7f22f902-2b76-40e9-bcf2-20436b275e9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:30:26.674308 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-7f22f902-2b76-40e9-bcf2-20436b275e9a admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083379 Feb 21 00:30:26.674806 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Mon Feb 21 00:30:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:30:27.952665 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:27.953651 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Feb 21 00:30:27.954045 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:28.147919 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-231bc833-bc67-48f7-930a-3a14fc1abd00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:30:28.175834 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-231bc833-bc67-48f7-930a-3a14fc1abd00 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085958 Feb 21 00:30:28.176309 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Mon Feb 21 00:30:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 00:30:29.428305 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:29.429369 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Feb 21 00:30:29.429757 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:30:29.623197 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-9eb0a566-a1f8-4538-a1e3-36b5482dd479 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:30:29.654264 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-9eb0a566-a1f8-4538-a1e3-36b5482dd479 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.089018 Feb 21 00:30:29.655010 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Mon Feb 21 00:30:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:31:19.834130 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:31:19.835230 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c25e081b-3906-4b00-8b9e-d6f3bec70009 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Feb 21 00:31:19.835596 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 930 bytes} [Mon Feb 21 00:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:31:19.904968 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-bd5e4118-665e-46b3-8b9e-540aa3e7cd51 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:31:19.930868 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-bd5e4118-665e-46b3-8b9e-540aa3e7cd51 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.088926 Feb 21 00:31:19.931396 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1291 bytes} [Mon Feb 21 00:31:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:31:19.953527 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-f7cd401c-cc57-4ca7-9943-7fa453ddf926 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:31:19.962272 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-f7cd401c-cc57-4ca7-9943-7fa453ddf926 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012365 Feb 21 00:31:19.962811 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1282 bytes} [Mon Feb 21 00:31:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:31:19.979243 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-f22b8215-7e90-4e55-8295-ca893e712f5f admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:31:19.991328 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-f22b8215-7e90-4e55-8295-ca893e712f5f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020304 Feb 21 00:31:19.991837 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1285 bytes} [Mon Feb 21 00:31:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:31:20.006511 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-c143da51-e5a3-407c-9600-1d476ab55a64 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:31:20.016115 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-c143da51-e5a3-407c-9600-1d476ab55a64 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015716 Feb 21 00:31:20.016857 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1285 bytes} [Mon Feb 21 00:31:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:31:20.032417 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:31:20.041500 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012724 Feb 21 00:31:20.042112 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1282 bytes} [Mon Feb 21 00:31:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:32:52.580735 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-401aef0f-6b2a-441e-b38d-350e9a1e0734 tempest-verify_tempest_config-1344478545 tempest-verify_tempest_config-1344478545-project] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:32:52.582715 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-401aef0f-6b2a-441e-b38d-350e9a1e0734 tempest-verify_tempest_config-1344478545 tempest-verify_tempest_config-1344478545-project] 10.222.0.72 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.110599 Feb 21 00:32:52.583243 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 34/69] 10.222.0.72 () {58 vars in 1133 bytes} [Mon Feb 21 00:32:52 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:34:32.358942 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:34:32.360251 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Feb 21 00:34:32.360849 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 36/70] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:34:32.632088 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-db5d8c9f-8fb7-4eaf-9d3e-db413ed1ab9c admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:34:32.633273 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:34:32.633273 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: warnings.warn(msg) Feb 21 00:34:32.634807 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-db5d8c9f-8fb7-4eaf-9d3e-db413ed1ab9c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:34:32.635249 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-db5d8c9f-8fb7-4eaf-9d3e-db413ed1ab9c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:34:32.636041 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-db5d8c9f-8fb7-4eaf-9d3e-db413ed1ab9c admin admin] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:34:32.636518 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-db5d8c9f-8fb7-4eaf-9d3e-db413ed1ab9c admin admin] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:34:32.669199 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-db5d8c9f-8fb7-4eaf-9d3e-db413ed1ab9c admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156034 Feb 21 00:34:32.669751 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 35/71] 10.222.0.72 () {60 vars in 1193 bytes} [Mon Feb 21 00:34:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:34:33.939865 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:34:33.940904 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Feb 21 00:34:33.941305 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 37/72] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:34:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:34:34.137420 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-06a0caf9-419a-4124-acf5-4e919efab326 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:34:34.138562 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:34:34.138562 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: warnings.warn(msg) Feb 21 00:34:34.140108 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-06a0caf9-419a-4124-acf5-4e919efab326 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:34:34.140576 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-06a0caf9-419a-4124-acf5-4e919efab326 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:34:34.141360 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-06a0caf9-419a-4124-acf5-4e919efab326 admin admin] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:34:34.141776 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-06a0caf9-419a-4124-acf5-4e919efab326 admin admin] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:34:34.160523 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-06a0caf9-419a-4124-acf5-4e919efab326 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082371 Feb 21 00:34:34.161063 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 36/73] 10.222.0.72 () {60 vars in 1193 bytes} [Mon Feb 21 00:34:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:34:45.846941 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:34:45.849942 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005712 Feb 21 00:34:45.850339 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 38/74] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:34:45 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:34:46.051499 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-02bd8575-c158-4d84-9200-2de22ba082fe admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:34:46.053233 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:34:46.053233 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: warnings.warn(msg) Feb 21 00:34:46.055569 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-02bd8575-c158-4d84-9200-2de22ba082fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:34:46.056220 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-02bd8575-c158-4d84-9200-2de22ba082fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:34:46.057433 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-02bd8575-c158-4d84-9200-2de22ba082fe admin admin] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:34:46.058000 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-02bd8575-c158-4d84-9200-2de22ba082fe admin admin] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:34:46.083929 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-02bd8575-c158-4d84-9200-2de22ba082fe admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089859 Feb 21 00:34:46.084494 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 37/75] 10.222.0.72 () {60 vars in 1193 bytes} [Mon Feb 21 00:34:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:34:47.377948 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: DEBUG nova.api.openstack.wsgi [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] Calling method '>' {{(pid=102197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:34:47.378982 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: INFO nova.api.openstack.requestlog [None req-a5cd42a1-474c-4f96-bb8f-fb22c7b6d3d8 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Feb 21 00:34:47.379445 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: [pid: 102197|app: 0|req: 39/76] 10.222.0.72 () {56 vars in 1074 bytes} [Mon Feb 21 00:34:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:34:47.579427 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG nova.api.openstack.wsgi [None req-6801ea02-89da-4260-bc33-be6c4bb3ce08 admin admin] Calling method '>' {{(pid=102198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:34:47.581450 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:34:47.581450 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: warnings.warn(msg) Feb 21 00:34:47.583767 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-6801ea02-89da-4260-bc33-be6c4bb3ce08 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:34:47.584360 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-6801ea02-89da-4260-bc33-be6c4bb3ce08 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:34:47.585592 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-6801ea02-89da-4260-bc33-be6c4bb3ce08 admin admin] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:34:47.586209 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: DEBUG oslo_concurrency.lockutils [None req-6801ea02-89da-4260-bc33-be6c4bb3ce08 admin admin] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:34:47.610205 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: INFO nova.api.openstack.requestlog [None req-6801ea02-89da-4260-bc33-be6c4bb3ce08 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089891 Feb 21 00:34:47.610764 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: [pid: 102198|app: 0|req: 38/77] 10.222.0.72 () {60 vars in 1193 bytes} [Mon Feb 21 00:34:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:35:46.184752 dv-cinder-813226-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 21 00:35:46.185329 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: Mon Feb 21 00:35:46 2022 - graceful shutdown triggered... Feb 21 00:35:46.185776 dv-cinder-813226-6-iscsi devstack@n-api.service[102197]: Gracefully killing worker 1 (pid: 102197)... Feb 21 00:35:46.186401 dv-cinder-813226-6-iscsi devstack@n-api.service[102198]: Gracefully killing worker 2 (pid: 102198)... Feb 21 00:35:47.186592 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: worker 1 buried after 1 seconds Feb 21 00:35:47.186592 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: worker 2 buried after 1 seconds Feb 21 00:35:47.186592 dv-cinder-813226-6-iscsi devstack@n-api.service[102196]: goodbye to uWSGI. Feb 21 00:35:47.189088 dv-cinder-813226-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 21 00:35:47.189984 dv-cinder-813226-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 21 00:35:47.194189 dv-cinder-813226-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 00:35:47.219945 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 00:35:47 2022] *** Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: nodename: dv-cinder-813226-6-iscsi Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: machine: x86_64 Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: clock source: unix Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: pcre jit disabled Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: detected number of CPU cores: 4 Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: current working directory: / Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: detected binary path: /usr/bin/uwsgi-core Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: your processes number limit is 47680 Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: your memory page size is 4096 bytes Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: detected max file descriptor number: 2048 Feb 21 00:35:47.222008 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: lock engine: pthread robust mutexes Feb 21 00:35:47.222998 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: thunder lock: enabled Feb 21 00:35:47.222998 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 00:35:47.222998 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 00:35:47.267439 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: Python main interpreter initialized at 0x55faf8e969c0 Feb 21 00:35:47.267439 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: python threads support enabled Feb 21 00:35:47.267439 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: your server socket listen backlog is limited to 100 connections Feb 21 00:35:47.267439 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: your mercy for graceful operations on workers is 90 seconds Feb 21 00:35:47.267901 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 00:35:47.267901 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: *** Operational MODE: preforking *** Feb 21 00:35:47.268164 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: *** uWSGI is running in multiple interpreter mode *** Feb 21 00:35:47.268164 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: spawned uWSGI master process (pid: 123086) Feb 21 00:35:47.268345 dv-cinder-813226-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 00:35:47.268958 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: spawned uWSGI worker 1 (pid: 123097, cores: 1) Feb 21 00:35:47.269321 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: spawned uWSGI worker 2 (pid: 123098, cores: 1) Feb 21 00:35:47.270571 dv-cinder-813226-6-iscsi devstack@n-api.service[123086]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 00:35:49.148531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:35:49.148531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: from cryptography.utils import int_from_bytes Feb 21 00:35:49.149252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:35:49.149252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: from cryptography.utils import int_from_bytes Feb 21 00:35:49.149252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:35:49.149252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: from cryptography.utils import int_from_bytes Feb 21 00:35:49.149826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:35:49.149826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: from cryptography.utils import int_from_bytes Feb 21 00:35:51.503024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 00:35:51.504017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 00:35:51.504557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 00:35:51.504950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 00:35:51.505163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 00:35:51.505562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.505898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.506228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.506554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.506918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.507235 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.507565 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.507890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.508210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.508499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.508818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.509147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813226-6-iscsi {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.509468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.509802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.510119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.510224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 00:35:51.510601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 00:35:51.510709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.510709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.511003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 00:35:51.511128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.511334 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.511437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 00:35:51.511579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 00:35:51.511840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.511964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.512342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.512613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.512934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.513160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.513272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.513590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.513916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.514101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.514211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.514561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.514686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.514868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.515041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.515182 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.515318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.515635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.516027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.516148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.516269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.516484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813226-6-iscsi {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.516663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.516858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.516975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813226-6-iscsi {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.517142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.517242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.517454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.517571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.517854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.518058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.518292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.518498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.518705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.518942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.519147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.519346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.519539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.519713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.519713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.520056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.520056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.520382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.520724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.521030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.521360 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.521677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.522009 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.522325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.522637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.522893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.523191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.523506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.523844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.524273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.524495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.524719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.525023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.525209 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.525973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.526127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.526280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.526428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.526588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.526588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.526866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.527004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.527227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.527374 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.527512 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.527657 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.527803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.527941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.528092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.528240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.528432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.528589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.528739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.528886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.529034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.529274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.529417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813226-6-iscsi {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.529562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.529724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.529872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.530010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.530154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.530298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.530455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.530455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.530835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.531013 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.531272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.531582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.531910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.532226 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.532588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.532903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.533228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.533587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.533895 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.534115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.534585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.534738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.535055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.535368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.535681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.535992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.536200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.536359 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.536705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.536843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.537004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.537143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.537292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.537436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.537582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.537720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.537864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.538008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.538146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.538290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.538427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.538625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.538788 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.538958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.539449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.539681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.539835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.539987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.540133 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.540278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.540457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.540609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.540761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.541050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.541193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.541452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.541597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.541763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.541915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.542053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.542289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.542455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.542702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.542856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.543004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.543142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.543295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.543446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.543596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.543744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.543890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.544112 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.544274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.544616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.544848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.544991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.545130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.545267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.545418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.545557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.545702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.545860 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.546006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.546153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.546308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.546446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.546583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.546736 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.546884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.547028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.547266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.547408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.547545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.547689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.547838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.547985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.548122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.548122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.548381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.548544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.548690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.548840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.548987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.549125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.549262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.549398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.549544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.549722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.549936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.550089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.550235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.550383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.550530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.550681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.550827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.550984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.551196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.551345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.551514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.551747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.551891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.551891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.552177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.552511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.552676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.552885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.553029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.553167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.553312 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.553463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.553610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.553756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.553905 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.554053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.554279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.554435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.554707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.554868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.555095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.555269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.556024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.556184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.556333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.556499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.556657 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.556816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.556967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.557114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.557260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.557406 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.557545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.557648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.557742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.557821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.557890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.558056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.558151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.558234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.558333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.558423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.558423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.558577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.558577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.558577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.558794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.558931 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.559009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.559263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.559342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.559591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.559679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.559982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.560146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.560236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.560519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.560738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.560848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.560961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.561145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.561351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.561475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.561605 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.561826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.561949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.562106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.562239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.562447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.562568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.562764 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.562905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.563105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.563226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.563405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.563532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.563721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.563833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.564035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.564155 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.564361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.564504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.564763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.564941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.565111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.565346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.565503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.565658 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.565813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.565952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.565952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.566251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.566398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.566537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.566676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.566813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.566962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.567101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.567246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.567932 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.568092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.568236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.568236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.568700 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.568842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.568992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.569131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.569268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.569416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.569555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.569700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.569849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.569988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.570208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.570366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.570512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.570662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:35:51.570809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.570809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.571093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.571232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.571522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.571675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.571815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.572061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.572220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.572367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.572550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.573567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.573743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.573891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.574046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.574204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.574541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.574686 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.574978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.575134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.575283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.575431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.575586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.575813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.575968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.576121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.576260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.576415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.576562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.576701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.576839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.576992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.577140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.577278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.577423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.577561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.577699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.577860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.578006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.578154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.578292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.578513 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.578667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.578807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.578944 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.579089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.579239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.579386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.579607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.579749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.579899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.580045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.580202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.580591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.580752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.580901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.580901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.581172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.581311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.581449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.581685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.581830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.581968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.582355 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.582502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.582651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.582821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.583039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.583183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.583412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.583563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.583717 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.583855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.584002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.584147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.584302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.584458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.584671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.584822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.585097 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.585241 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.585379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.585517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.585664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.585828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.586063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.586207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.586354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.586528 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.586675 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.586822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.586961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.587099 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.587237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.587386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.587533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.587672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.587817 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.587963 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.588100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.588250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.588441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.588588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.588811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.588952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.589090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.589236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.589374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.589520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.589660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.589805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.589944 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.590095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.590235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.590411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.590631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.590838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.591001 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.591141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.591278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.591424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.591562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.591785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.591939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.592089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.592237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.592499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.592672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.592821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.592971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.593191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.593349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.593568 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.593712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.593853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.594035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.594260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.594402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.594549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.594707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.594855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.594994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.595273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.595421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.595559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.595697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.595848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.595996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.596233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.596384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.596581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.596719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.596880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.597027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.597173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.597321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.597458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.597611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.597758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.597903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.598042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.598198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.598337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.598483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.598630 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.598785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.598923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.599061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.599199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.599418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.599558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.599696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.599840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.599978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.600116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.600266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.600421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.600575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.600826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.601032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.601177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.601330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.601478 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.601616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.601771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.601973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.602129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.602269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.602422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.602787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.602942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.603088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.603324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.603472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.603698 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.603843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.604056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.604219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.604371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.604534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.604673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.604821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.605040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.605321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.605476 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.605615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.605760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.605915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.606053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.606204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.606448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.606599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.606747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.606887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.607024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.607176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.607334 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.607482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.607629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.607767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.607912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.608064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.608210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.608356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.608562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.609395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.609569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.609776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.609927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.610065 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.610280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.610475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.610617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.610755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.611086 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.611306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.611464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.611611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.611758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.611896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.612131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.612298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.612471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.612615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.612755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.613010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.613161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.613318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.613552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.613714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.613931 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.614075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.614215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.614215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.614514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.614660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.614799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.614936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.615081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.615232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.615541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.615681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.615827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.615974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.616120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.616120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.616431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.616762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.616917 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.617065 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.617203 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.617354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.617500 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.617646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.617784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.617930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.618083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.618230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.618368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.618525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.618670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.618816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.618962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.619101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.619240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.619377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.619533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.619679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.619825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.619970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.620887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.621974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.622107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.622355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.622660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.622758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.622851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.622968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.623070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.623162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.623246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.623331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.623414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.623710 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.623804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.623915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.624845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625319 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625696 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625871 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.625955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.626923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627437 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.627949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.628938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.629030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.629218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.629326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.629537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.629627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.629851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.629941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.630164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.630261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.630471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.630568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.630775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.630864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.631081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.631177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.631474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.631585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.631714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.631982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.632080 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.632324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.632494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.632675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.632784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.632989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.633081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.633299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.633389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.633616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.633723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.633929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.634030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.634236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.634336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.634553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.634644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.634883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.634973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.635207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.635307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.635516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.635607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.635824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.635925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.636133 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.636225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.636465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.636556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.636780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.636870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.637088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.637174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.637395 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.637494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.637700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.637804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.638007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.638104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.638313 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.638637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.638637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.638797 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.638924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.639010 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.639251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.639339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.639548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.639639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.639855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.639942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.640161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.640260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.640510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.640601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.640855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.640956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.641242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.641345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.641581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.641683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.641874 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.641971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.642187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.642290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.642509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.642616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.642826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.642917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.643146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.643247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.643461 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.643550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.643779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.643868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.644095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.644196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.644417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.644509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.644734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.644836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.645041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.645134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.645358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.645483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.645673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.645768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.645979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.646116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.646296 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.646379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.646605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.646684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.646921 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.647003 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.647345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.647437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.647516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.647599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.647832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.647923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.648139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.648218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.648548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.648677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.648789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.648897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.649083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.649204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.649436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.649570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.649686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.649797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.649997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.650717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.650834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.650953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.651061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.651167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.651281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.651389 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.651525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.651654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.651842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.651955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.652073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.652179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.652295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.652485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.652690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.652810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.652810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.652999 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.653093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.653178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.653337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.653427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.653653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.653756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.654010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.654096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.654322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.654423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.654638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.654738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.654947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.655042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.655255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.655354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.655567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.655736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.655894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.655994 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.656210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.656307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.656587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.656697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.656911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.657034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.657223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.657307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.657536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.657651 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.657845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.657977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.658160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.658263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.658465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.658593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.658773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.658857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.659080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.659230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.659389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.659505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.659697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.659805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.660009 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.660106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.660320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.660490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.660655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.660746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.660966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.661057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.661273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.661387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.661621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.661711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.661934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.662050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.662295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.662393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.662607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.662720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.662936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.663046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.663261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.663360 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.663580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.663670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.663895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.664000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.664551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.664662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.664862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.664953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.665182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.665288 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.665498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.665589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.665815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.665914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.666124 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.666223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.666431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.666535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.666738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.666837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.667058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.667149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.667372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.667469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.667691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.667798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.668012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.668102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.668341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.668473 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.668782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.668884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.669029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.669127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.669347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.669438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.669664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.669782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.669977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.670068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.670295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.670383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.670609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.670707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.670920 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.671024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.671235 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.671335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.671548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.671651 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.671862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.671966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.672223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.672324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.672560 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.672664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.672879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.672983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.673189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.673284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.673498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.673596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.673820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.673916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.674126 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.674216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.674438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.674529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.674750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.674851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.675063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.675166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.675373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.675465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.675688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.675811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.676019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.676111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.676337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.676446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.676692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.676784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.677006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.677111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.677316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.677414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.677655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.677752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.677967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.678074 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.678270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.678361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.678617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.678707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.678951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.679050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.679269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.679359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.679595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.679730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.679903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.679995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.680212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.680342 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.680550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.680642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.680881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.680968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.681192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.681275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.681499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.681589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.681804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.681883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.682115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.682192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.682465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.682548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.682721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.682805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.683037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.683146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.683346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.683467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.683654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.683779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.683964 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.684273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.684535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.684857 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.685182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.685366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.685510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.685719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.685838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.686071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.686164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.686406 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.686496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.686732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.686835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.687058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.687138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.687379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.687458 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.687767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.687851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.688088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.688179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.689959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.690030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.690107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.690305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.690402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.690594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.690676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.690915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.690995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.691244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.691323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.691575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.691667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.691884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.691963 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.692199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.692287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.699956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.699956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.700985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.701997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.702913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.703962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.704949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.705870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706407 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706656 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.706971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.707055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.707339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.707441 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.707645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.707878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.707993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.708301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.708442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.708666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.708854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.708988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.709306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.709408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.709638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.709825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.709942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.710274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.710415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.710595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.710705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.710913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.711017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.711264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.711368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.711585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.711680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.711908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.712177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.712270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.712535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.712633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.712864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.712976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.713191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.713283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.713510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.713604 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.713830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.713922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.714150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.714390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.714505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.714731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.714841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.715054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.715194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.715376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.715490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.715691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.715785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.716000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.716099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.716320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.716501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.716663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.716765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.716972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.717062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.717289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.717393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.717607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.717704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.717938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.718139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.718366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.718499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.718595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.718819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.718941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.719181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.719272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.719521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.719847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722185 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.722968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723409 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723478 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723643 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.723956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.724040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.724113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.724191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.724263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.724559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.724682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.724772 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.724976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.725052 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.725131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.725349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.725454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.725647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.725738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.725960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.726040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.726271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.726396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.726583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.726747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.726900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.726980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.727209 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.727328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.727537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.727764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.727850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.728108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.728196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.728437 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.728546 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.728758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.728850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.729100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.729191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.729423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.729529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.729731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.729835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.730041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.730133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.730362 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.730536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.730669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.730759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.730988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.731087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.731299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.731389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.731604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.731694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.731933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.732079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.732253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.732339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.732589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.732824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.732915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.733170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.733272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.733498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.733745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.733846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.734098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.734197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.734421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.734537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.734804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.734916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.735124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.735233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.735445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.735611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.735761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.735863 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.736098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.736201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.736381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.736493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.736719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.736810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.737034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.737124 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.737344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.737459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.737658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.737762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.737963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.738064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.738276 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.738364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.738588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.738676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.738900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.738992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.739216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.739308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.739523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.739622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.739854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.739953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.740165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.740257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.740498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.740593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.740809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.740901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.741125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.741223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.741432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.741530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.741741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.741833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.742051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.742150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.742359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.742465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.742673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.742766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.742988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.743079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.743296 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.743394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.743602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.743731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.743915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.744054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.744224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.744440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.744566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.744777 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.744928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.745118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.745256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.745434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.745573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.745771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.745875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.746091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.746195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.746422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.746521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.746743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.746856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.747083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.747187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.747396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.747485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.747747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.747847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.748072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.748173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.748383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.748630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.748721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.749029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.749164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.749355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.749460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.749692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.749784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.750030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.750129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.750388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.750482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.750706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.750806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.751019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.751120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.751344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.751442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.751660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.751750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.751978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.752079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.752295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.752446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.752639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.752731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.752957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.753063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.753271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.753350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.753586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.753666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.753903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.753991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.754219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.754309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.754533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.754629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.754849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.754939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.755164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.755253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.755495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.755594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.755824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.755924 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.756131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.756239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.756476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.756649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.756802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.756901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.757118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.757210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.757434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.757534 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.757750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.757848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.758062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.758164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.758379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.758480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.758694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.758798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.759019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.759115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.759328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.759420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.759645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.759741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.759972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.760063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.760301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.760503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.760659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.760797 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.760997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.761091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.761332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.761670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.762024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.762109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.762345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.762434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.762696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.762775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.763029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.763108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.763348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.763435 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.763664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.763743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.763976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.764066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.764271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 00:35:51.764359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.765490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.765490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.765490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.765737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.765922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.766263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.766600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.766924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.767251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.767567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.767896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.768215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.768579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.768910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.769233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.769552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.769885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.770205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.770520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.770835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.771151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.771469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.771784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.772116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.772469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.772782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.773118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.773442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.773765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.774088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.774403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.774736 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.775051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.775368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.775689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.776085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.776319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.776664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.776990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.777323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.777655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.777988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.778325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.778673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.778994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.779346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.779678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.779998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.780315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.780674 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:35:51.780922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 00:35:51.787167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_db.sqlalchemy.engines [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:35:51.803827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_db.sqlalchemy.engines [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:35:51.852008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.context [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ada545b6-27f6-4ebc-a627-b9fe2dee4e97(cell1) {{(pid=123097) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 00:35:51.856291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:35:51.857919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:35:51.858747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:35:51.860769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:35:51.869269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.context [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ada545b6-27f6-4ebc-a627-b9fe2dee4e97(cell1) {{(pid=123098) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 00:35:51.871742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_db.sqlalchemy.engines [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:35:51.873423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_db.sqlalchemy.engines [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:35:51.873948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:35:51.875900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:35:51.876858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:35:51.879245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:35:51.890570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_db.sqlalchemy.engines [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:35:51.892304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_db.sqlalchemy.engines [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:35:52.031549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_db.sqlalchemy.engines [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:35:52.050319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_db.sqlalchemy.engines [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:35:52.363755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: WARNING keystonemiddleware.auth_token [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 00:35:52.371804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: WARNING keystonemiddleware.auth_token [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 00:35:52.376757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: WARNING keystonemiddleware.auth_token [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 00:35:52.383376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: WARNING keystonemiddleware.auth_token [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 00:35:52.709655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: WARNING keystonemiddleware.auth_token [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 00:35:52.714779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: WARNING keystonemiddleware.auth_token [None req-2cd88c69-2a7b-44a6-bf8e-e5ef4acccaba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 00:35:52.720283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55faf8e969c0 pid: 123097 (default app) Feb 21 00:35:52.725032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: WARNING keystonemiddleware.auth_token [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 00:35:52.730236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: WARNING keystonemiddleware.auth_token [None req-e4138902-3cd1-4f43-9842-c1bc6f04087c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 00:35:52.735617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55faf8e969c0 pid: 123098 (default app) Feb 21 00:36:30.295995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f03b0246-9470-479b-85fd-a80ec5375b09 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Action: 'create', calling method: .version_select at 0x7fe56f2960d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-88468509", "metadata": {"Type": "work"}}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:30.673956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-16659b71-03b8-4f9f-a89d-6f5504be5e26 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Action: 'create', calling method: .version_select at 0x7fe56f2970d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1240345105"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:32.159639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f03b0246-9470-479b-85fd-a80ec5375b09 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.425776 Feb 21 00:36:32.167382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1155 bytes} [Mon Feb 21 00:36:28 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 21 00:36:32.421737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-330458196", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "56db0597-ae15-4f37-bb63-de139366805c"}]}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:32.605355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.network.neutron [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] validate_networks() for [('56db0597-ae15-4f37-bb63-de139366805c', None, None, None, None, None)] {{(pid=123097) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:36:32.977233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-16659b71-03b8-4f9f-a89d-6f5504be5e26 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.510188 Feb 21 00:36:32.978431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1/2] 10.222.0.72 () {60 vars in 1154 bytes} [Mon Feb 21 00:36:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3513 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 21 00:36:32.984151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c6fd7c51-5c34-4d6c-bc2d-f6abe37990db tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f14cca0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:33.108485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c6fd7c51-5c34-4d6c-bc2d-f6abe37990db tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 351 microversion: 2.1 time: 0.128277 Feb 21 00:36:33.109510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:32 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:33.115615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-36a810b3-4de0-4528-abaf-7d48c77e346e tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f14ce50>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:33.213230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-36a810b3-4de0-4528-abaf-7d48c77e346e tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a" status: 200 len: 345 microversion: 2.1 time: 0.100241 Feb 21 00:36:33.220361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 3/4] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:33 2022] GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:34.121417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-23e48cb9-efe1-404c-94f9-dc5ae9f4a196 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f169670>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:34.267056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-23e48cb9-efe1-404c-94f9-dc5ae9f4a196 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 352 microversion: 2.1 time: 0.149049 Feb 21 00:36:34.267890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 4/5] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:34 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:36:34.272626 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-36055265-4452-48e5-94dc-fb4ac2a48b64 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f0f2040>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:34.392506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-36055265-4452-48e5-94dc-fb4ac2a48b64 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a" status: 200 len: 346 microversion: 2.1 time: 0.123244 Feb 21 00:36:34.399632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 5/6] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:34 2022] GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:34.405118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d4469e25-a222-473d-a68d-275010aa6492 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f14cee0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:34.575323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d4469e25-a222-473d-a68d-275010aa6492 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 352 microversion: 2.1 time: 0.173885 Feb 21 00:36:34.576232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 6/7] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:34 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 352 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:34.581566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b991ba59-37b9-4a19-b161-41a59ab2d5ce tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Action: 'create', calling method: .version_select at 0x7fe56f0f2280>, body: {"snapshot": {"volume_id": "7204ec6f-525b-46ac-b274-2b8023e4b66a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1183026175"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:34.882777 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Flavor limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:36:34.883293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Image limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:36:34.884216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Flavor pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:36:34.884753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Image pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:36:34.885300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:36:34.917594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:34.918151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:34.919119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:34.919645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:35.002990 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Getting quotas for project 8b8b3a6e4540426fae8d800fbd140571. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:36:35.024993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Getting quotas for user 7754c5b970334acb9b0e24a41a33bfea and project 8b8b3a6e4540426fae8d800fbd140571. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:36:35.038482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b991ba59-37b9-4a19-b161-41a59ab2d5ce tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.461082 Feb 21 00:36:35.039632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 7/8] 10.222.0.72 () {60 vars in 1161 bytes} [Mon Feb 21 00:36:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:35.049117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2a1dc006-3002-4e02-a15a-b6a4815e6c04 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f1693a0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:35.049297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Going to run 1 instances... {{(pid=123097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:36:35.052311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:36:35.166502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2a1dc006-3002-4e02-a15a-b6a4815e6c04 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 202 len: 0 microversion: 2.1 time: 0.124214 Feb 21 00:36:35.167655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 8/9] 10.222.0.72 () {58 vars in 1247 bytes} [Mon Feb 21 00:36:35 2022] DELETE /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:36:35.175107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cb493239-6930-4de0-b0fe-9b21f0fbda09 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f0f2dc0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:35.225093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cb493239-6930-4de0-b0fe-9b21f0fbda09 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 200 len: 287 microversion: 2.1 time: 0.056195 Feb 21 00:36:35.231326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 9/10] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:35 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:35.236873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c3654594-6f85-4e8a-8687-82301ada3fb8 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f0f2430>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:35.238148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-13fc0b67-4818-4313-b224-38d7a60e882c tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.067931 Feb 21 00:36:35.240213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 2/11] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 00:36:35.259579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b69c8bd3-f4d6-4d16-9285-9eea5188928b tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f06f5e0>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:35.340959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c3654594-6f85-4e8a-8687-82301ada3fb8 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 351 microversion: 2.1 time: 0.108230 Feb 21 00:36:35.341770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 10/12] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:35 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:35.351032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0166bbf7-c92d-4817-acd2-1ff4a82922cd tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:35.352350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0166bbf7-c92d-4817-acd2-1ff4a82922cd tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:35.405743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b69c8bd3-f4d6-4d16-9285-9eea5188928b tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.162194 Feb 21 00:36:35.410337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 3/13] 10.222.0.72 () {58 vars in 1139 bytes} [Mon Feb 21 00:36:35 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:35.421429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-be6345d6-e389-4174-800b-8893da69d09b tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56e8065e0>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:35.557456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-be6345d6-e389-4174-800b-8893da69d09b tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 200 len: 287 microversion: 2.1 time: 0.140246 Feb 21 00:36:35.558575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 4/14] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:35 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:35.655870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0166bbf7-c92d-4817-acd2-1ff4a82922cd tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:35.689129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0166bbf7-c92d-4817-acd2-1ff4a82922cd tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1214 microversion: 2.1 time: 0.344659 Feb 21 00:36:35.692506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 11/15] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:35 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:36.354712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b707e390-9865-49d7-a188-5f80f740e31c tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f06fee0>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:36.494923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b707e390-9865-49d7-a188-5f80f740e31c tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 351 microversion: 2.1 time: 0.144639 Feb 21 00:36:36.495496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 5/16] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:36 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:36.572519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-34a13980-a54a-419e-a4c1-b5e0f543c81e tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f169b80>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:36.654932 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-34a13980-a54a-419e-a4c1-b5e0f543c81e tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 200 len: 287 microversion: 2.1 time: 0.088996 Feb 21 00:36:36.655757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 12/17] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:36 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:36.710275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-61caeaf1-44ea-47b8-ba19-84d6185e9218 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:36.711614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-61caeaf1-44ea-47b8-ba19-84d6185e9218 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:36.947636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-61caeaf1-44ea-47b8-ba19-84d6185e9218 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:36.975004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-61caeaf1-44ea-47b8-ba19-84d6185e9218 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1214 microversion: 2.1 time: 0.270153 Feb 21 00:36:36.985382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 6/18] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:36 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:37.511958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f5ce3033-feb0-472a-9b1e-8a669f3dc5ff tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f0b2ca0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:37.614091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f5ce3033-feb0-472a-9b1e-8a669f3dc5ff tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 351 microversion: 2.1 time: 0.109661 Feb 21 00:36:37.614869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 13/19] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:37 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:37.669242 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b2fa7305-8067-484f-b2dd-aadd93ac7dee tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f0eb310>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:37.738233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b2fa7305-8067-484f-b2dd-aadd93ac7dee tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 200 len: 287 microversion: 2.1 time: 0.074120 Feb 21 00:36:37.738820 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 7/20] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:37 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:37.994063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9cd1ea0f-61fe-4951-badd-0a146d0c7837 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:37.994929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9cd1ea0f-61fe-4951-badd-0a146d0c7837 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:38.019843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9cd1ea0f-61fe-4951-badd-0a146d0c7837 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:38.022551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9cd1ea0f-61fe-4951-badd-0a146d0c7837 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:38.024864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9cd1ea0f-61fe-4951-badd-0a146d0c7837 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:38.026292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9cd1ea0f-61fe-4951-badd-0a146d0c7837 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:38.335968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9cd1ea0f-61fe-4951-badd-0a146d0c7837 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:38.349108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9cd1ea0f-61fe-4951-badd-0a146d0c7837 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1218 microversion: 2.1 time: 0.359958 Feb 21 00:36:38.351914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 14/21] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:37 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1218 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:38.627231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-72c6baec-8939-4400-8407-f648eedffe96 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56e823dc0>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:38.717321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-72c6baec-8939-4400-8407-f648eedffe96 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 351 microversion: 2.1 time: 0.094085 Feb 21 00:36:38.718223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 8/22] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:38 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:38.749759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cb3db3a1-2a8e-487a-abfd-2e222864a0f4 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f03b790>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:38.812830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cb3db3a1-2a8e-487a-abfd-2e222864a0f4 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 200 len: 287 microversion: 2.1 time: 0.066914 Feb 21 00:36:38.813951 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 15/23] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:38 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:39.405763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1beef4c4-814c-49c4-8a58-05d5223b2880 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:39.405763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1beef4c4-814c-49c4-8a58-05d5223b2880 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:39.415903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1beef4c4-814c-49c4-8a58-05d5223b2880 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:39.415903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1beef4c4-814c-49c4-8a58-05d5223b2880 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:39.416843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1beef4c4-814c-49c4-8a58-05d5223b2880 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:39.419044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1beef4c4-814c-49c4-8a58-05d5223b2880 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:39.499525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8818d020-f92c-475b-a059-2dd5823dd72e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'create', calling method: .version_select at 0x7fe56dfb7160>, body: {"keypair": {"name": "tempest-keypair-726585088"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:39.534584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-8818d020-f92c-475b-a059-2dd5823dd72e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for project c9e2484e716a4d078e8314885525ee23. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:36:39.539346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1beef4c4-814c-49c4-8a58-05d5223b2880 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:39.552852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1beef4c4-814c-49c4-8a58-05d5223b2880 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1218 microversion: 2.1 time: 0.181886 Feb 21 00:36:39.553698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 16/24] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:39 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:39.565606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-8818d020-f92c-475b-a059-2dd5823dd72e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for user 4bb4137c17e343e3a8d91ba801ecfbd9 and project c9e2484e716a4d078e8314885525ee23. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:36:39.730680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-aaf79024-3a07-4c1f-8f4d-2a14d75d1604 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f0a4f70>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:39.821434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-aaf79024-3a07-4c1f-8f4d-2a14d75d1604 tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 351 microversion: 2.1 time: 0.095207 Feb 21 00:36:39.826588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 17/25] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:39 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:36:39.835559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-94e5abd6-7dcc-411f-be96-fdedc1e71535 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f03b310>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:39.916931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-94e5abd6-7dcc-411f-be96-fdedc1e71535 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 200 len: 287 microversion: 2.1 time: 0.085126 Feb 21 00:36:39.917851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 18/26] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:39 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:40.361050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-8818d020-f92c-475b-a059-2dd5823dd72e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for project c9e2484e716a4d078e8314885525ee23. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:36:40.365975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-8818d020-f92c-475b-a059-2dd5823dd72e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for user 4bb4137c17e343e3a8d91ba801ecfbd9 and project c9e2484e716a4d078e8314885525ee23. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:36:40.386015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8818d020-f92c-475b-a059-2dd5823dd72e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.332891 Feb 21 00:36:40.386828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 9/27] 10.222.0.72 () {60 vars in 1157 bytes} [Mon Feb 21 00:36:39 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:40.572154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-713e6d3d-35ad-4998-9327-b3a743421287 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:40.573481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-713e6d3d-35ad-4998-9327-b3a743421287 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:40.604099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-713e6d3d-35ad-4998-9327-b3a743421287 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:40.606368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-713e6d3d-35ad-4998-9327-b3a743421287 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:40.607251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-713e6d3d-35ad-4998-9327-b3a743421287 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:40.609537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-713e6d3d-35ad-4998-9327-b3a743421287 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:40.769698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-713e6d3d-35ad-4998-9327-b3a743421287 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:40.788146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-713e6d3d-35ad-4998-9327-b3a743421287 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1218 microversion: 2.1 time: 0.220142 Feb 21 00:36:40.802033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 19/28] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:40 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1218 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:40.834542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3a605601-2ded-47d9-ad67-3211fbb81f3b tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56dfb7ca0>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:40.933916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3a605601-2ded-47d9-ad67-3211fbb81f3b tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 200 len: 351 microversion: 2.1 time: 0.103498 Feb 21 00:36:40.935146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 10/29] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:40 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:40.941397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1c578c65-4ce1-48a3-ae9e-dac7cbcb5e04 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f06ff70>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:40.994095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1c578c65-4ce1-48a3-ae9e-dac7cbcb5e04 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 200 len: 288 microversion: 2.1 time: 0.068861 Feb 21 00:36:40.994655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 20/30] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:40 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 288 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:41.006716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-74cf158e-2ea7-479e-9040-a872bba087ec tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56dfba940>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:41.111330 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-74cf158e-2ea7-479e-9040-a872bba087ec tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 202 len: 0 microversion: 2.1 time: 0.109944 Feb 21 00:36:41.112748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 11/31] 10.222.0.72 () {58 vars in 1253 bytes} [Mon Feb 21 00:36:40 2022] DELETE /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:36:41.121570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-aa98ce62-4c7c-4416-9328-88cf599d9747 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f06f4c0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:41.177678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-aa98ce62-4c7c-4416-9328-88cf599d9747 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 200 len: 287 microversion: 2.1 time: 0.058591 Feb 21 00:36:41.182726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 21/32] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:41 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:36:41.819942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-777025aa-a84c-4069-b0ed-23ef5b6bb55d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:41.820656 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-777025aa-a84c-4069-b0ed-23ef5b6bb55d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:41.830118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-777025aa-a84c-4069-b0ed-23ef5b6bb55d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:41.830567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-777025aa-a84c-4069-b0ed-23ef5b6bb55d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:41.831368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-777025aa-a84c-4069-b0ed-23ef5b6bb55d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:41.831796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-777025aa-a84c-4069-b0ed-23ef5b6bb55d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:41.867985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-126957551", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:42.094383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.network.neutron [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] validate_networks() for [('a6aaad8e-e40d-43b5-acb3-be47e9557845', None, None, None, None, None)] {{(pid=123097) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:36:42.279475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-777025aa-a84c-4069-b0ed-23ef5b6bb55d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:42.289467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-777025aa-a84c-4069-b0ed-23ef5b6bb55d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1274 microversion: 2.1 time: 0.477662 Feb 21 00:36:42.290083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 22/33] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:41 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1274 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:42.314086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ff6a6561-1409-4708-916c-a3b45f1d606a tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Calling method '.version_select at 0x7fe56f06f670>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:42.384659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-ff6a6561-1409-4708-916c-a3b45f1d606a tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] HTTP exception thrown: Volume c2c72563-8c77-4126-9eeb-628786ba191a could not be found. Feb 21 00:36:42.385228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ff6a6561-1409-4708-916c-a3b45f1d606a tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] Returning 404 to user: Volume c2c72563-8c77-4126-9eeb-628786ba191a could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:42.385988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ff6a6561-1409-4708-916c-a3b45f1d606a tempest-VolumesGetTestJSON-1153437159 tempest-VolumesGetTestJSON-1153437159-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a" status: 404 len: 109 microversion: 2.1 time: 0.083770 Feb 21 00:36:42.386542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 23/34] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:42 2022] GET /compute/v2.1/os-volumes/c2c72563-8c77-4126-9eeb-628786ba191a => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:36:42.398766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f25b0f03-5a3f-4e42-ae53-d2a8ca2d6955 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f7208b0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:42.467979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-f25b0f03-5a3f-4e42-ae53-d2a8ca2d6955 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] HTTP exception thrown: Snapshot 70d216a2-3541-41f6-b655-4ef817e3e16a could not be found. Feb 21 00:36:42.468721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f25b0f03-5a3f-4e42-ae53-d2a8ca2d6955 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Returning 404 to user: Snapshot 70d216a2-3541-41f6-b655-4ef817e3e16a could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:42.470385 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f25b0f03-5a3f-4e42-ae53-d2a8ca2d6955 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a" status: 404 len: 111 microversion: 2.1 time: 0.077043 Feb 21 00:36:42.471219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 24/35] 10.222.0.72 () {58 vars in 1250 bytes} [Mon Feb 21 00:36:42 2022] GET /compute/v2.1/os-snapshots/70d216a2-3541-41f6-b655-4ef817e3e16a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:36:42.495309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-37c55b4a-ea7d-472f-8eee-de55291ca263 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f0b2e50>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:42.621739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-37c55b4a-ea7d-472f-8eee-de55291ca263 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a" status: 202 len: 0 microversion: 2.1 time: 0.137436 Feb 21 00:36:42.623204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 25/36] 10.222.0.72 () {58 vars in 1247 bytes} [Mon Feb 21 00:36:42 2022] DELETE /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:36:42.631561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ecd6c23e-a7d4-4f60-b783-40997f3bbe23 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f0b28b0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:42.727693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ecd6c23e-a7d4-4f60-b783-40997f3bbe23 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a" status: 200 len: 345 microversion: 2.1 time: 0.098520 Feb 21 00:36:42.728590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 26/37] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:42 2022] GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:36:43.307655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-01c1ba50-b635-43ac-81e6-5ec74b755e93 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:43.308370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-01c1ba50-b635-43ac-81e6-5ec74b755e93 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:43.318207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01c1ba50-b635-43ac-81e6-5ec74b755e93 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:43.324677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01c1ba50-b635-43ac-81e6-5ec74b755e93 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:43.325761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01c1ba50-b635-43ac-81e6-5ec74b755e93 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:43.326272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01c1ba50-b635-43ac-81e6-5ec74b755e93 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:43.535803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-01c1ba50-b635-43ac-81e6-5ec74b755e93 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:43.547770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-01c1ba50-b635-43ac-81e6-5ec74b755e93 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1272 microversion: 2.1 time: 0.244025 Feb 21 00:36:43.550416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 27/38] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:43 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:43.744152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6cb94186-adb9-4ac7-8a2c-22760a23f60e tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f06f940>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:43.846922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-6cb94186-adb9-4ac7-8a2c-22760a23f60e tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] HTTP exception thrown: Volume 7204ec6f-525b-46ac-b274-2b8023e4b66a could not be found. Feb 21 00:36:43.847766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6cb94186-adb9-4ac7-8a2c-22760a23f60e tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Returning 404 to user: Volume 7204ec6f-525b-46ac-b274-2b8023e4b66a could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:43.848861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6cb94186-adb9-4ac7-8a2c-22760a23f60e tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a" status: 404 len: 109 microversion: 2.1 time: 0.111778 Feb 21 00:36:43.855649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 28/39] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:43 2022] GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:36:43.865154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e9fd46a2-1204-445b-a4d3-66feb03c4f36 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f0109d0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:43.966666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-e9fd46a2-1204-445b-a4d3-66feb03c4f36 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] HTTP exception thrown: Volume 7204ec6f-525b-46ac-b274-2b8023e4b66a could not be found. Feb 21 00:36:43.968766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e9fd46a2-1204-445b-a4d3-66feb03c4f36 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Returning 404 to user: Volume 7204ec6f-525b-46ac-b274-2b8023e4b66a could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:43.970137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e9fd46a2-1204-445b-a4d3-66feb03c4f36 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a" status: 404 len: 109 microversion: 2.1 time: 0.113441 Feb 21 00:36:43.971069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 29/40] 10.222.0.72 () {58 vars in 1247 bytes} [Mon Feb 21 00:36:43 2022] DELETE /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:36:43.982128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3e0d28cc-9781-42d2-8bca-fc3236e99d96 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Calling method '.version_select at 0x7fe56f010dc0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:44.067175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-3e0d28cc-9781-42d2-8bca-fc3236e99d96 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] HTTP exception thrown: Volume 7204ec6f-525b-46ac-b274-2b8023e4b66a could not be found. Feb 21 00:36:44.067175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3e0d28cc-9781-42d2-8bca-fc3236e99d96 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] Returning 404 to user: Volume 7204ec6f-525b-46ac-b274-2b8023e4b66a could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:44.067175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3e0d28cc-9781-42d2-8bca-fc3236e99d96 tempest-VolumesSnapshotsTestJSON-724469732 tempest-VolumesSnapshotsTestJSON-724469732-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a" status: 404 len: 109 microversion: 2.1 time: 0.089391 Feb 21 00:36:44.067175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 30/41] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:43 2022] GET /compute/v2.1/os-volumes/7204ec6f-525b-46ac-b274-2b8023e4b66a => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 00:36:44.568091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5dbfd14d-b9e6-41d0-b5c6-4cd64311df77 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:44.569472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5dbfd14d-b9e6-41d0-b5c6-4cd64311df77 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:44.584369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5dbfd14d-b9e6-41d0-b5c6-4cd64311df77 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:44.588540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5dbfd14d-b9e6-41d0-b5c6-4cd64311df77 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:44.590900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5dbfd14d-b9e6-41d0-b5c6-4cd64311df77 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:44.591742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5dbfd14d-b9e6-41d0-b5c6-4cd64311df77 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:44.785129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Flavor limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:36:44.787387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Image limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:36:44.788195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Flavor pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:36:44.789079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Image pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:36:44.790256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:36:44.848322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:44.848912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:44.849751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:44.850184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:44.878738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5dbfd14d-b9e6-41d0-b5c6-4cd64311df77 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:44.891550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5dbfd14d-b9e6-41d0-b5c6-4cd64311df77 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1272 microversion: 2.1 time: 0.327480 Feb 21 00:36:44.896191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 31/42] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:44 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1272 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:44.927604 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Getting quotas for project 520a17e70e484b2a89470f10c4b29c40. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:36:44.940367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Getting quotas for user b5bad9e824c94386b78c96dcceb23e13 and project 520a17e70e484b2a89470f10c4b29c40. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:36:45.014427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Going to run 1 instances... {{(pid=123097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:36:45.019860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:36:45.162610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fa5e55db-8a1c-4a0d-9232-071242043b53 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.576396 Feb 21 00:36:45.163261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 12/43] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:36:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 3578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 00:36:45.174910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-50e098a9-dbc0-4fd4-840f-e7fb2611ec1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:45.175721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-50e098a9-dbc0-4fd4-840f-e7fb2611ec1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:45.780724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-50e098a9-dbc0-4fd4-840f-e7fb2611ec1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:45.795174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-50e098a9-dbc0-4fd4-840f-e7fb2611ec1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1221 microversion: 2.1 time: 0.622610 Feb 21 00:36:45.815397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 32/44] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:45 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1221 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:36:45.910286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1b3dee25-5484-4cf3-ba59-27bf2a9866aa tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:45.911602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1b3dee25-5484-4cf3-ba59-27bf2a9866aa tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:45.924240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b3dee25-5484-4cf3-ba59-27bf2a9866aa tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:45.930113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b3dee25-5484-4cf3-ba59-27bf2a9866aa tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:45.933090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b3dee25-5484-4cf3-ba59-27bf2a9866aa tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:45.935379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b3dee25-5484-4cf3-ba59-27bf2a9866aa tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:46.112846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1730115492", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:46.451409 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] validate_networks() for [('a6aaad8e-e40d-43b5-acb3-be47e9557845', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:36:47.625982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1b3dee25-5484-4cf3-ba59-27bf2a9866aa tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:47.669848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1b3dee25-5484-4cf3-ba59-27bf2a9866aa tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 1.757570 Feb 21 00:36:47.669848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 13/45] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:45 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:47.676834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-750562512", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "598c85cd-5729-4005-9409-664298fecc1d"}], "security_groups": [{"name": "tempest-securitygroup--341593094"}], "key_name": "tempest-keypair-726585088", "user_data": "}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:48.261906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.network.neutron [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] validate_networks() for [('598c85cd-5729-4005-9409-664298fecc1d', None, None, None, None, None)] {{(pid=123097) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:36:50.996732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:36:50.997237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:36:50.997610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:36:50.998012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:36:50.998534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:36:51.047166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:51.047628 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:51.048500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:51.048936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:51.176420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Getting quotas for project 520a17e70e484b2a89470f10c4b29c40. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:36:51.199615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Getting quotas for user b5bad9e824c94386b78c96dcceb23e13 and project 520a17e70e484b2a89470f10c4b29c40. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:36:51.243334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:36:51.248550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:36:51.475337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cfee515c-28f8-4937-925a-19a639571a2e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.368918 Feb 21 00:36:51.480942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 33/46] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:36:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 5371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 00:36:52.025835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Flavor limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:36:52.027475 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Image limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:36:52.028281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Flavor pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:36:52.030418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Image pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:36:52.031266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:36:52.069707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:52.073517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:52.077806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:52.082346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:52.199639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for project c9e2484e716a4d078e8314885525ee23. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:36:52.218308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for user 4bb4137c17e343e3a8d91ba801ecfbd9 and project c9e2484e716a4d078e8314885525ee23. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:36:52.271157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Going to run 1 instances... {{(pid=123097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:36:52.277647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:36:52.344894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7035ea8e-b7ce-4978-9a4d-9ffc522e0f56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Action: 'create', calling method: .version_select at 0x7fe56ef59940>, body: {"keypair": {"name": "tempest-keypair-1587300889"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:52.400776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-7035ea8e-b7ce-4978-9a4d-9ffc522e0f56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for project c06103339bc54d0f93b531034454d6ab. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:36:52.407428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d5e548b1-8774-4d52-a77b-59ede22bedd7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.738914 Feb 21 00:36:52.409866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 14/47] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:36:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 4742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 00:36:52.426044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8cbba4d8-8a41-4bc2-ab3b-e5f3e5d3024a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:52.427935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-7035ea8e-b7ce-4978-9a4d-9ffc522e0f56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for user 1d9176fb26604a1190825afedf8823cb and project c06103339bc54d0f93b531034454d6ab. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:36:52.430402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8cbba4d8-8a41-4bc2-ab3b-e5f3e5d3024a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:52.458737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8cbba4d8-8a41-4bc2-ab3b-e5f3e5d3024a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:52.462845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8cbba4d8-8a41-4bc2-ab3b-e5f3e5d3024a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:52.469888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8cbba4d8-8a41-4bc2-ab3b-e5f3e5d3024a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:52.471942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8cbba4d8-8a41-4bc2-ab3b-e5f3e5d3024a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:53.707959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8cbba4d8-8a41-4bc2-ab3b-e5f3e5d3024a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:53.728140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8cbba4d8-8a41-4bc2-ab3b-e5f3e5d3024a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 1.311951 Feb 21 00:36:53.730275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 15/48] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:52 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:54.143320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-7035ea8e-b7ce-4978-9a4d-9ffc522e0f56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for project c06103339bc54d0f93b531034454d6ab. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:36:54.163360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-7035ea8e-b7ce-4978-9a4d-9ffc522e0f56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for user 1d9176fb26604a1190825afedf8823cb and project c06103339bc54d0f93b531034454d6ab. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:36:54.216472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7035ea8e-b7ce-4978-9a4d-9ffc522e0f56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.738565 Feb 21 00:36:54.222825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 34/49] 10.222.0.72 () {62 vars in 1198 bytes} [Mon Feb 21 00:36:51 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2746 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 21 00:36:54.228225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8241f94d-2930-464e-9e97-9b3d2d5aea69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:54.229121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8241f94d-2930-464e-9e97-9b3d2d5aea69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:54.242663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8241f94d-2930-464e-9e97-9b3d2d5aea69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:54.243585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8241f94d-2930-464e-9e97-9b3d2d5aea69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:54.243983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8241f94d-2930-464e-9e97-9b3d2d5aea69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:54.244446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8241f94d-2930-464e-9e97-9b3d2d5aea69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:54.257610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0a84d7c2-8304-47de-814f-35b8165ed4be tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Action: 'create', calling method: .version_select at 0x7fe56d6fd790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1699262786", "metadata": {"Type": "work"}}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:54.259859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0a84d7c2-8304-47de-814f-35b8165ed4be tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:54.262122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0a84d7c2-8304-47de-814f-35b8165ed4be tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.528502 Feb 21 00:36:54.262981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 16/50] 10.222.0.72 () {60 vars in 1155 bytes} [Mon Feb 21 00:36:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 532 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:36:54.649989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8241f94d-2930-464e-9e97-9b3d2d5aea69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:54.659110 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8241f94d-2930-464e-9e97-9b3d2d5aea69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1280 microversion: 2.1 time: 0.435085 Feb 21 00:36:54.659744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 35/51] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:54 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1280 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:54.679110 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-08e0d116-6e6d-4500-adac-495ba54d94c2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:54.679733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-08e0d116-6e6d-4500-adac-495ba54d94c2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:54.713605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-08e0d116-6e6d-4500-adac-495ba54d94c2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:54.714033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-08e0d116-6e6d-4500-adac-495ba54d94c2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:54.714832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-08e0d116-6e6d-4500-adac-495ba54d94c2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:54.715268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-08e0d116-6e6d-4500-adac-495ba54d94c2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:54.825640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-f35b71da-ce9f-445a-8f76-5730723e8764 req-bfae495a-c997-4b69-865d-a4b6f2b60c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47fdd17-aabc-46ec-b8eb-1611ca351b02", "tag": "e67eb7bd-3133-41a3-bc80-324738730e42"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:54.829647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:36:54.829647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:36:54.857660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-f35b71da-ce9f-445a-8f76-5730723e8764 req-bfae495a-c997-4b69-865d-a4b6f2b60c7b service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:54.859631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-f35b71da-ce9f-445a-8f76-5730723e8764 req-bfae495a-c997-4b69-865d-a4b6f2b60c7b service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:54.924789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-f35b71da-ce9f-445a-8f76-5730723e8764 req-bfae495a-c997-4b69-865d-a4b6f2b60c7b service nova] Creating event network-changed:e67eb7bd-3133-41a3-bc80-324738730e42 for instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 on hv-cinder-81322 Feb 21 00:36:54.926101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-f35b71da-ce9f-445a-8f76-5730723e8764 req-bfae495a-c997-4b69-865d-a4b6f2b60c7b service nova] Acquired lock "compute-rpcapi-router" {{(pid=123097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 00:36:54.927414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71e89117-3ea7-4d89-9ec2-92d5f5108e7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:54.930189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71e89117-3ea7-4d89-9ec2-92d5f5108e7b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:54.932954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71e89117-3ea7-4d89-9ec2-92d5f5108e7b None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:54.933577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71e89117-3ea7-4d89-9ec2-92d5f5108e7b None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:54.958982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.compute.rpcapi [None req-71e89117-3ea7-4d89-9ec2-92d5f5108e7b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 00:36:54.960650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71e89117-3ea7-4d89-9ec2-92d5f5108e7b None None] Releasing lock "compute-rpcapi-router" {{(pid=123097) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 00:36:54.984246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-71e89117-3ea7-4d89-9ec2-92d5f5108e7b None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.719582 Feb 21 00:36:54.985897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 17/52] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:54.994252 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7ef42428-ace7-47d0-a86f-af0e240786a4 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Action: 'create', calling method: .version_select at 0x7fe56f780d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1421515312", "metadata": {"Type": "work"}}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:54.996250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7ef42428-ace7-47d0-a86f-af0e240786a4 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:54.998580 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7ef42428-ace7-47d0-a86f-af0e240786a4 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009738 Feb 21 00:36:54.999952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 18/53] 10.222.0.72 () {60 vars in 1155 bytes} [Mon Feb 21 00:36:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:36:55.007981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-54a0ed56-e013-4130-b4ab-0480d9e242e8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:55.009054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-54a0ed56-e013-4130-b4ab-0480d9e242e8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:55.020458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54a0ed56-e013-4130-b4ab-0480d9e242e8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:55.021532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54a0ed56-e013-4130-b4ab-0480d9e242e8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:55.023430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54a0ed56-e013-4130-b4ab-0480d9e242e8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:55.024268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54a0ed56-e013-4130-b4ab-0480d9e242e8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:55.095648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-08e0d116-6e6d-4500-adac-495ba54d94c2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:55.118423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-08e0d116-6e6d-4500-adac-495ba54d94c2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1288 microversion: 2.1 time: 0.457526 Feb 21 00:36:55.128864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 36/54] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:54 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1288 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:55.133743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dffbc09c-bdd1-4565-bfb0-8836d164b0be tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Action: 'create', calling method: .version_select at 0x7fe56f05fd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1926173451", "metadata": {"Type": "work"}}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:55.135189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dffbc09c-bdd1-4565-bfb0-8836d164b0be tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:55.135995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dffbc09c-bdd1-4565-bfb0-8836d164b0be tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006646 Feb 21 00:36:55.163061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 37/55] 10.222.0.72 () {60 vars in 1155 bytes} [Mon Feb 21 00:36:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:36:55.184959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2eb3a033-d756-451e-afca-2fb291f3e2f7 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Calling method '.version_select at 0x7fe56df28700>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:55.245322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-2eb3a033-d756-451e-afca-2fb291f3e2f7 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] HTTP exception thrown: Volume tempest-invalid-1863587179 could not be found. Feb 21 00:36:55.246020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2eb3a033-d756-451e-afca-2fb291f3e2f7 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Returning 404 to user: Volume tempest-invalid-1863587179 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:55.246879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2eb3a033-d756-451e-afca-2fb291f3e2f7 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1863587179" status: 404 len: 99 microversion: 2.1 time: 0.077974 Feb 21 00:36:55.247741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 38/56] 10.222.0.72 () {58 vars in 1217 bytes} [Mon Feb 21 00:36:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1863587179 => generated 99 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 21 00:36:55.257197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b4719094-ad8d-4db0-aa5b-89dbc3f02cb3 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003767 Feb 21 00:36:55.257723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 39/57] 10.222.0.72 () {58 vars in 1139 bytes} [Mon Feb 21 00:36:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 21 00:36:55.267037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-16b04296-680d-4fc8-84b1-b8603b9eb1e7 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003861 Feb 21 00:36:55.268121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 40/58] 10.222.0.72 () {58 vars in 1136 bytes} [Mon Feb 21 00:36:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 21 00:36:55.277053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b21d5d5b-baa9-4ed2-a758-728f86f1a401 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Calling method '.version_select at 0x7fe56df15940>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:55.369434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-b21d5d5b-baa9-4ed2-a758-728f86f1a401 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] HTTP exception thrown: Volume 4d489d5f-adb4-428a-b2d2-b886d8961e84 could not be found. Feb 21 00:36:55.374508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b21d5d5b-baa9-4ed2-a758-728f86f1a401 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Returning 404 to user: Volume 4d489d5f-adb4-428a-b2d2-b886d8961e84 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:55.375895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b21d5d5b-baa9-4ed2-a758-728f86f1a401 tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/4d489d5f-adb4-428a-b2d2-b886d8961e84" status: 404 len: 109 microversion: 2.1 time: 0.102615 Feb 21 00:36:55.376926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 41/59] 10.222.0.72 () {58 vars in 1247 bytes} [Mon Feb 21 00:36:55 2022] DELETE /compute/v2.1/os-volumes/4d489d5f-adb4-428a-b2d2-b886d8961e84 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:36:55.386270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6f3fd3d0-8ef1-4597-8ff6-5d8754e51afe tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Calling method '.version_select at 0x7fe56df151f0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:55.456179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-6f3fd3d0-8ef1-4597-8ff6-5d8754e51afe tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] HTTP exception thrown: Volume 0f0d4827-0ba0-49bd-85ae-b0cbc9bbaa70 could not be found. Feb 21 00:36:55.456864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6f3fd3d0-8ef1-4597-8ff6-5d8754e51afe tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] Returning 404 to user: Volume 0f0d4827-0ba0-49bd-85ae-b0cbc9bbaa70 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:36:55.457815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6f3fd3d0-8ef1-4597-8ff6-5d8754e51afe tempest-VolumesNegativeTest-473677225 tempest-VolumesNegativeTest-473677225-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/0f0d4827-0ba0-49bd-85ae-b0cbc9bbaa70" status: 404 len: 109 microversion: 2.1 time: 0.075556 Feb 21 00:36:55.458840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 42/60] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:36:55 2022] GET /compute/v2.1/os-volumes/0f0d4827-0ba0-49bd-85ae-b0cbc9bbaa70 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 00:36:55.678906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a369f9f5-4494-4036-9c83-3ffaa3f42dce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:55.679518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a369f9f5-4494-4036-9c83-3ffaa3f42dce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:55.689771 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a369f9f5-4494-4036-9c83-3ffaa3f42dce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:55.690223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a369f9f5-4494-4036-9c83-3ffaa3f42dce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:55.691105 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a369f9f5-4494-4036-9c83-3ffaa3f42dce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:55.691681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a369f9f5-4494-4036-9c83-3ffaa3f42dce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:56.025341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a369f9f5-4494-4036-9c83-3ffaa3f42dce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:56.033202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a369f9f5-4494-4036-9c83-3ffaa3f42dce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1280 microversion: 2.1 time: 0.359723 Feb 21 00:36:56.047095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 43/61] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:55 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1280 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:56.141013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b56862fd-c732-43bd-9b91-a96f39699452 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:56.141943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b56862fd-c732-43bd-9b91-a96f39699452 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:56.151904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b56862fd-c732-43bd-9b91-a96f39699452 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:56.152460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b56862fd-c732-43bd-9b91-a96f39699452 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:56.154981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b56862fd-c732-43bd-9b91-a96f39699452 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:56.155559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b56862fd-c732-43bd-9b91-a96f39699452 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:56.818572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b56862fd-c732-43bd-9b91-a96f39699452 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:56.829963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b56862fd-c732-43bd-9b91-a96f39699452 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1294 microversion: 2.1 time: 0.697763 Feb 21 00:36:56.831066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 44/62] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:56 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1294 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:56.941577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-f8e929c9-36b2-42a8-a845-e5304c039048 req-df1bf0fc-efa9-4b63-93f2-d98a1142d237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bedd6d6-814a-48db-a1ca-b35b01e44759", "tag": "7d5e4a15-788e-4ca8-ab9b-4b2d972b4aa0"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:36:56.944021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:36:56.944021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:36:56.955145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-f8e929c9-36b2-42a8-a845-e5304c039048 req-df1bf0fc-efa9-4b63-93f2-d98a1142d237 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:56.955621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-f8e929c9-36b2-42a8-a845-e5304c039048 req-df1bf0fc-efa9-4b63-93f2-d98a1142d237 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:57.009678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-f8e929c9-36b2-42a8-a845-e5304c039048 req-df1bf0fc-efa9-4b63-93f2-d98a1142d237 service nova] Creating event network-changed:7d5e4a15-788e-4ca8-ab9b-4b2d972b4aa0 for instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 on hv-cinder-81322 Feb 21 00:36:57.011857 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-f8e929c9-36b2-42a8-a845-e5304c039048 req-df1bf0fc-efa9-4b63-93f2-d98a1142d237 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 00:36:57.015706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2083142a-b2bc-4e07-8951-a4df7eb471f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:57.016456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2083142a-b2bc-4e07-8951-a4df7eb471f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:57.017906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2083142a-b2bc-4e07-8951-a4df7eb471f4 None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:57.018536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2083142a-b2bc-4e07-8951-a4df7eb471f4 None None] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:57.028645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.compute.rpcapi [None req-2083142a-b2bc-4e07-8951-a4df7eb471f4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 00:36:57.050625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2083142a-b2bc-4e07-8951-a4df7eb471f4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 00:36:57.104506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2083142a-b2bc-4e07-8951-a4df7eb471f4 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269987 Feb 21 00:36:57.105753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 45/63] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:36:57.113652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1488d0a0-4018-48a6-a7db-5080ca3255a5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:57.114670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1488d0a0-4018-48a6-a7db-5080ca3255a5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:57.123810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1488d0a0-4018-48a6-a7db-5080ca3255a5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:57.124519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1488d0a0-4018-48a6-a7db-5080ca3255a5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:57.125633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1488d0a0-4018-48a6-a7db-5080ca3255a5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:57.126407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1488d0a0-4018-48a6-a7db-5080ca3255a5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:57.269580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1488d0a0-4018-48a6-a7db-5080ca3255a5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:57.279831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1488d0a0-4018-48a6-a7db-5080ca3255a5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1280 microversion: 2.1 time: 0.171191 Feb 21 00:36:57.280709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 46/64] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:57 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:57.411547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-54a0ed56-e013-4130-b4ab-0480d9e242e8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:57.421062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-54a0ed56-e013-4130-b4ab-0480d9e242e8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 2.419826 Feb 21 00:36:57.421639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 19/65] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:55 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:57.847187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-94ad8a1c-13c5-4dc8-81c7-a03b500d9dd9 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:57.847897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-94ad8a1c-13c5-4dc8-81c7-a03b500d9dd9 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:57.860680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ad8a1c-13c5-4dc8-81c7-a03b500d9dd9 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:57.861398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ad8a1c-13c5-4dc8-81c7-a03b500d9dd9 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:57.862301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ad8a1c-13c5-4dc8-81c7-a03b500d9dd9 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:57.862949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ad8a1c-13c5-4dc8-81c7-a03b500d9dd9 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:58.252987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-94ad8a1c-13c5-4dc8-81c7-a03b500d9dd9 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:58.262320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-94ad8a1c-13c5-4dc8-81c7-a03b500d9dd9 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.418744 Feb 21 00:36:58.268243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 47/66] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:57 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:58.297479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-36be09aa-c85c-4b3a-9298-2162ed18b3ca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:58.298530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-36be09aa-c85c-4b3a-9298-2162ed18b3ca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:58.306108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-36be09aa-c85c-4b3a-9298-2162ed18b3ca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:58.307098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-36be09aa-c85c-4b3a-9298-2162ed18b3ca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:58.308271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-36be09aa-c85c-4b3a-9298-2162ed18b3ca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:58.308909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-36be09aa-c85c-4b3a-9298-2162ed18b3ca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:58.437792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0aead76e-38bd-4c9e-82ac-3a22e5b26681 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:58.438990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0aead76e-38bd-4c9e-82ac-3a22e5b26681 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:58.452845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0aead76e-38bd-4c9e-82ac-3a22e5b26681 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:58.458239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0aead76e-38bd-4c9e-82ac-3a22e5b26681 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:58.459317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0aead76e-38bd-4c9e-82ac-3a22e5b26681 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:58.460426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0aead76e-38bd-4c9e-82ac-3a22e5b26681 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:58.653550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-36be09aa-c85c-4b3a-9298-2162ed18b3ca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:58.664067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-36be09aa-c85c-4b3a-9298-2162ed18b3ca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.369276 Feb 21 00:36:58.675386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 20/67] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:58 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:58.707994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0aead76e-38bd-4c9e-82ac-3a22e5b26681 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:36:58.716855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0aead76e-38bd-4c9e-82ac-3a22e5b26681 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.282652 Feb 21 00:36:58.718557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 48/68] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:58 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:36:59.286491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1371d6dd-f472-4573-ab45-b5cb6ec79c81 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:59.287532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1371d6dd-f472-4573-ab45-b5cb6ec79c81 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:59.299075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1371d6dd-f472-4573-ab45-b5cb6ec79c81 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:59.300559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1371d6dd-f472-4573-ab45-b5cb6ec79c81 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:59.302055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1371d6dd-f472-4573-ab45-b5cb6ec79c81 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:59.304674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1371d6dd-f472-4573-ab45-b5cb6ec79c81 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:59.685073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b0a0142b-f561-44e9-a45d-04e6d7fd1048 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:36:59.687258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b0a0142b-f561-44e9-a45d-04e6d7fd1048 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:36:59.701152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0a0142b-f561-44e9-a45d-04e6d7fd1048 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:59.702090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0a0142b-f561-44e9-a45d-04e6d7fd1048 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:36:59.705083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0a0142b-f561-44e9-a45d-04e6d7fd1048 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:36:59.706464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0a0142b-f561-44e9-a45d-04e6d7fd1048 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:00.134607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1371d6dd-f472-4573-ab45-b5cb6ec79c81 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:00.144170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1371d6dd-f472-4573-ab45-b5cb6ec79c81 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.861173 Feb 21 00:37:00.146946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 21/69] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:59 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:00.159245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1e381c32-e07c-4602-b45f-09970615ebcf tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:00.161763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1e381c32-e07c-4602-b45f-09970615ebcf tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:00.185891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e381c32-e07c-4602-b45f-09970615ebcf tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:00.188444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e381c32-e07c-4602-b45f-09970615ebcf tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:00.189711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e381c32-e07c-4602-b45f-09970615ebcf tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:00.192664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e381c32-e07c-4602-b45f-09970615ebcf tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:00.280306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b0a0142b-f561-44e9-a45d-04e6d7fd1048 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:00.287757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b0a0142b-f561-44e9-a45d-04e6d7fd1048 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.609715 Feb 21 00:37:00.294631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 49/70] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:36:59 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:00.513813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1e381c32-e07c-4602-b45f-09970615ebcf tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:00.539606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1e381c32-e07c-4602-b45f-09970615ebcf tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.390133 Feb 21 00:37:00.540853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 22/71] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:00 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:00.641829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-283673205", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a392dac-feaa-4ee9-a8a2-bdfc4029b2f0"}], "security_groups": [{"name": "tempest-securitygroup--1830524661"}], "key_name": "tempest-keypair-1587300889", "user_data": "}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:00.686842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-cc5a5ae0-45e3-43ff-a420-f305d06533fe req-b2894757-b46f-4282-9398-c90000f08318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d637a83e-8fb7-4b8c-b617-e8d245844ee2", "tag": "1cd9b49c-50c7-4d52-af67-9e9f7f069840"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:00.689498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:37:00.689498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:37:00.723472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-cc5a5ae0-45e3-43ff-a420-f305d06533fe req-b2894757-b46f-4282-9398-c90000f08318 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:00.725434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-cc5a5ae0-45e3-43ff-a420-f305d06533fe req-b2894757-b46f-4282-9398-c90000f08318 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:00.757077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-cc5a5ae0-45e3-43ff-a420-f305d06533fe req-b2894757-b46f-4282-9398-c90000f08318 service nova] Creating event network-changed:1cd9b49c-50c7-4d52-af67-9e9f7f069840 for instance d637a83e-8fb7-4b8c-b617-e8d245844ee2 on hv-cinder-81322 Feb 21 00:37:00.777199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-cc5a5ae0-45e3-43ff-a420-f305d06533fe req-b2894757-b46f-4282-9398-c90000f08318 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089222 Feb 21 00:37:00.778157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 23/72] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:00.965858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] validate_networks() for [('6a392dac-feaa-4ee9-a8a2-bdfc4029b2f0', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:37:01.164880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e538c9c3-14f1-4f79-89e4-acb263c8ee51 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:01.166194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e538c9c3-14f1-4f79-89e4-acb263c8ee51 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:01.179801 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e538c9c3-14f1-4f79-89e4-acb263c8ee51 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:01.180250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e538c9c3-14f1-4f79-89e4-acb263c8ee51 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:01.184055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e538c9c3-14f1-4f79-89e4-acb263c8ee51 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:01.186394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e538c9c3-14f1-4f79-89e4-acb263c8ee51 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:01.574845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e538c9c3-14f1-4f79-89e4-acb263c8ee51 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:01.593542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e538c9c3-14f1-4f79-89e4-acb263c8ee51 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.433614 Feb 21 00:37:01.594528 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 24/73] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:01 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:01.602259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2fa4f5cb-82e6-4bd1-9db7-4aa6bbd0fcd6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:01.603571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2fa4f5cb-82e6-4bd1-9db7-4aa6bbd0fcd6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:01.612327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2fa4f5cb-82e6-4bd1-9db7-4aa6bbd0fcd6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:01.613420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2fa4f5cb-82e6-4bd1-9db7-4aa6bbd0fcd6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:01.618611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2fa4f5cb-82e6-4bd1-9db7-4aa6bbd0fcd6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:01.619659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2fa4f5cb-82e6-4bd1-9db7-4aa6bbd0fcd6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:01.909375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2fa4f5cb-82e6-4bd1-9db7-4aa6bbd0fcd6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:01.917683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2fa4f5cb-82e6-4bd1-9db7-4aa6bbd0fcd6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.321893 Feb 21 00:37:01.931695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 25/74] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:01 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:01.938783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-cfb2e4bd-8814-4386-ad76-dd2544aa19b2 req-d81f05ec-4445-41f7-8029-ca3e2f46774a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2482a368-86ed-4e3c-aa3d-e414ae527066", "tag": "3e28f716-bca9-4286-8b93-1948b2352ec2"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:01.943230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:37:01.943230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:37:01.957578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-cfb2e4bd-8814-4386-ad76-dd2544aa19b2 req-d81f05ec-4445-41f7-8029-ca3e2f46774a service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:01.958257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-cfb2e4bd-8814-4386-ad76-dd2544aa19b2 req-d81f05ec-4445-41f7-8029-ca3e2f46774a service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:01.970828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-cfb2e4bd-8814-4386-ad76-dd2544aa19b2 req-d81f05ec-4445-41f7-8029-ca3e2f46774a service nova] Creating event network-changed:3e28f716-bca9-4286-8b93-1948b2352ec2 for instance 2482a368-86ed-4e3c-aa3d-e414ae527066 on hv-cinder-81322 Feb 21 00:37:01.975744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-cfb2e4bd-8814-4386-ad76-dd2544aa19b2 req-d81f05ec-4445-41f7-8029-ca3e2f46774a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042576 Feb 21 00:37:01.976920 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 26/75] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:01.981879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b74e58d1-8a0b-4857-87d5-448920bab816 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:01.983001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b74e58d1-8a0b-4857-87d5-448920bab816 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:01.989601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b74e58d1-8a0b-4857-87d5-448920bab816 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:01.990208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b74e58d1-8a0b-4857-87d5-448920bab816 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:01.991609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b74e58d1-8a0b-4857-87d5-448920bab816 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:01.992195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b74e58d1-8a0b-4857-87d5-448920bab816 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:02.081853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:37:02.082370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:37:02.083050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:37:02.083559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:37:02.084050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:37:02.096069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:02.096986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:02.100941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:02.102330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:02.152719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for project c06103339bc54d0f93b531034454d6ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:37:02.162737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for user 1d9176fb26604a1190825afedf8823cb and project c06103339bc54d0f93b531034454d6ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:37:02.187594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:37:02.190686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:37:02.329635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fe9ae12f-2bef-445e-86b3-5c2328db8d07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.692120 Feb 21 00:37:02.332404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 50/76] 10.222.0.72 () {62 vars in 1187 bytes} [Mon Feb 21 00:37:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 21 00:37:02.352591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d0a2e0bf-9919-49ec-935b-e43030784624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:02.353010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d0a2e0bf-9919-49ec-935b-e43030784624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:02.639727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d0a2e0bf-9919-49ec-935b-e43030784624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:02.654715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d0a2e0bf-9919-49ec-935b-e43030784624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:02.656747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d0a2e0bf-9919-49ec-935b-e43030784624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:02.668213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d0a2e0bf-9919-49ec-935b-e43030784624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1281 microversion: 2.20 time: 0.328073 Feb 21 00:37:02.669111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 51/77] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:02.683461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-47e6c010-3be9-4d7a-bb04-58f11206684a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:02.685476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-47e6c010-3be9-4d7a-bb04-58f11206684a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:02.690913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b74e58d1-8a0b-4857-87d5-448920bab816 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:02.696504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47e6c010-3be9-4d7a-bb04-58f11206684a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:02.698273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47e6c010-3be9-4d7a-bb04-58f11206684a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:02.701368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47e6c010-3be9-4d7a-bb04-58f11206684a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:02.703390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47e6c010-3be9-4d7a-bb04-58f11206684a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:02.716378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b74e58d1-8a0b-4857-87d5-448920bab816 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.733898 Feb 21 00:37:02.719661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 27/78] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:01 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:02.947025 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f424a5db-0fbf-4b01-be74-15fe34b4e935 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:02.949005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f424a5db-0fbf-4b01-be74-15fe34b4e935 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:02.964035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f424a5db-0fbf-4b01-be74-15fe34b4e935 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:02.965528 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f424a5db-0fbf-4b01-be74-15fe34b4e935 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:02.967254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f424a5db-0fbf-4b01-be74-15fe34b4e935 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:02.969283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f424a5db-0fbf-4b01-be74-15fe34b4e935 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:03.198557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f424a5db-0fbf-4b01-be74-15fe34b4e935 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:03.206762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f424a5db-0fbf-4b01-be74-15fe34b4e935 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.274003 Feb 21 00:37:03.208014 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 28/79] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:02 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:03.214749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-47e6c010-3be9-4d7a-bb04-58f11206684a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:03.229738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-47e6c010-3be9-4d7a-bb04-58f11206684a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.557298 Feb 21 00:37:03.243076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 52/80] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:02 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:03.690227 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:03.690617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:03.697377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:03.698683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:03.699601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:03.700420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:03.736627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a575839f-8c40-4e2a-ac40-e75be844f411 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:03.737320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a575839f-8c40-4e2a-ac40-e75be844f411 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:03.748901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a575839f-8c40-4e2a-ac40-e75be844f411 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:03.778312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a575839f-8c40-4e2a-ac40-e75be844f411 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:03.784703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a575839f-8c40-4e2a-ac40-e75be844f411 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:03.785452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a575839f-8c40-4e2a-ac40-e75be844f411 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:03.807660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:03.832535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:03.843477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:03.849797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d21251b7-e30e-4452-bd5f-7e87cf2d74f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1333 microversion: 2.20 time: 0.162280 Feb 21 00:37:03.851298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 29/81] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1333 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:04.161150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a575839f-8c40-4e2a-ac40-e75be844f411 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:04.172802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a575839f-8c40-4e2a-ac40-e75be844f411 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.440387 Feb 21 00:37:04.173836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 53/82] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:03 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:04.226369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2a01af92-7162-48c5-9990-046a1070fa45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:04.227083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2a01af92-7162-48c5-9990-046a1070fa45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:04.237196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2a01af92-7162-48c5-9990-046a1070fa45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:04.238846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2a01af92-7162-48c5-9990-046a1070fa45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:04.239811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2a01af92-7162-48c5-9990-046a1070fa45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:04.240316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2a01af92-7162-48c5-9990-046a1070fa45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:04.250411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f1b49ec6-52ab-4e6a-9622-50869ce6cd39 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:04.251431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f1b49ec6-52ab-4e6a-9622-50869ce6cd39 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:04.268647 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1b49ec6-52ab-4e6a-9622-50869ce6cd39 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:04.269306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1b49ec6-52ab-4e6a-9622-50869ce6cd39 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:04.269925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1b49ec6-52ab-4e6a-9622-50869ce6cd39 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:04.270359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1b49ec6-52ab-4e6a-9622-50869ce6cd39 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:04.635224 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2a01af92-7162-48c5-9990-046a1070fa45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:04.643246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2a01af92-7162-48c5-9990-046a1070fa45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.421861 Feb 21 00:37:04.643834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 30/83] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:04 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:04.674187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1b49ec6-52ab-4e6a-9622-50869ce6cd39 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:04.685503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f1b49ec6-52ab-4e6a-9622-50869ce6cd39 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.437973 Feb 21 00:37:04.687185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 54/84] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:04 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:04.873846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:04.874603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:04.883789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:04.884457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:04.885594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:04.886041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:04.970636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:04.993584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:04.995094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:04.996215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9423fe92-74b1-489f-83d0-e9b740ece358 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1339 microversion: 2.20 time: 0.131467 Feb 21 00:37:04.996815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 31/85] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1339 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:05.194871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1bad29ce-fa45-4b11-9428-c56d2ee32b61 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:05.195657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1bad29ce-fa45-4b11-9428-c56d2ee32b61 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:05.207575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bad29ce-fa45-4b11-9428-c56d2ee32b61 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:05.208087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bad29ce-fa45-4b11-9428-c56d2ee32b61 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:05.208971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bad29ce-fa45-4b11-9428-c56d2ee32b61 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:05.222835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bad29ce-fa45-4b11-9428-c56d2ee32b61 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:05.504304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1bad29ce-fa45-4b11-9428-c56d2ee32b61 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:05.512957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1bad29ce-fa45-4b11-9428-c56d2ee32b61 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.323893 Feb 21 00:37:05.540793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 55/86] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:05 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:05.660515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ec14e8f4-4f55-4db6-b92d-d3b99639707a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:05.661139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ec14e8f4-4f55-4db6-b92d-d3b99639707a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:05.670264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ec14e8f4-4f55-4db6-b92d-d3b99639707a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:05.671529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ec14e8f4-4f55-4db6-b92d-d3b99639707a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:05.674483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ec14e8f4-4f55-4db6-b92d-d3b99639707a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:05.676745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ec14e8f4-4f55-4db6-b92d-d3b99639707a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:05.703046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-23de342e-9464-4157-bd1f-afb270d57470 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:05.703655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-23de342e-9464-4157-bd1f-afb270d57470 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:05.711661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23de342e-9464-4157-bd1f-afb270d57470 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:05.712101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23de342e-9464-4157-bd1f-afb270d57470 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:05.717172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23de342e-9464-4157-bd1f-afb270d57470 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:05.718989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23de342e-9464-4157-bd1f-afb270d57470 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:05.901861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ec14e8f4-4f55-4db6-b92d-d3b99639707a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:05.912642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ec14e8f4-4f55-4db6-b92d-d3b99639707a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.256356 Feb 21 00:37:05.915742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 32/87] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:05 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:06.021240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:06.021992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:06.035570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:06.036015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:06.038925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:06.042150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:06.285082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:06.302100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:06.302827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-23de342e-9464-4157-bd1f-afb270d57470 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:06.303616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:06.305488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-becf834a-a1cc-4596-a979-4331af899569 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.289138 Feb 21 00:37:06.305488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 33/88] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:06 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:37:06.314685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-23de342e-9464-4157-bd1f-afb270d57470 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.615252 Feb 21 00:37:06.315553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 56/89] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:05 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:06.533937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f6876fe9-169e-47af-a0df-0e04084ad4b5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:06.538965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f6876fe9-169e-47af-a0df-0e04084ad4b5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:06.563594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6876fe9-169e-47af-a0df-0e04084ad4b5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:06.565167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6876fe9-169e-47af-a0df-0e04084ad4b5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:06.565973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6876fe9-169e-47af-a0df-0e04084ad4b5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:06.566401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6876fe9-169e-47af-a0df-0e04084ad4b5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:06.932503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f321eb0d-05d1-4dbf-b774-6375cfb6367e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:06.933369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f321eb0d-05d1-4dbf-b774-6375cfb6367e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:06.942510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f321eb0d-05d1-4dbf-b774-6375cfb6367e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:06.943573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f321eb0d-05d1-4dbf-b774-6375cfb6367e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:06.945268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f321eb0d-05d1-4dbf-b774-6375cfb6367e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:06.946978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f321eb0d-05d1-4dbf-b774-6375cfb6367e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:06.953649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f6876fe9-169e-47af-a0df-0e04084ad4b5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:06.964716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f6876fe9-169e-47af-a0df-0e04084ad4b5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.438026 Feb 21 00:37:06.973650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 34/90] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:06 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:06.986736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-b00f120f-50a9-4598-a827-223419cf0505 req-58a096e5-99f7-4533-b119-eedc1338d5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5aa3b9a-864e-42ff-81ec-278e00ddd8be", "tag": "d8dbce75-bbb2-4b0b-bc43-c864b59621e9"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:06.988907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:37:06.988907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:37:07.004517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-b00f120f-50a9-4598-a827-223419cf0505 req-58a096e5-99f7-4533-b119-eedc1338d5a5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:07.004959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-b00f120f-50a9-4598-a827-223419cf0505 req-58a096e5-99f7-4533-b119-eedc1338d5a5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:07.055382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-b00f120f-50a9-4598-a827-223419cf0505 req-58a096e5-99f7-4533-b119-eedc1338d5a5 service nova] Creating event network-changed:d8dbce75-bbb2-4b0b-bc43-c864b59621e9 for instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be on hv-cinder-81322 Feb 21 00:37:07.072430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-b00f120f-50a9-4598-a827-223419cf0505 req-58a096e5-99f7-4533-b119-eedc1338d5a5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088164 Feb 21 00:37:07.074460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 35/91] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:07.323681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:07.324599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:07.340285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:07.340782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:07.341655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:07.342094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:07.528483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f321eb0d-05d1-4dbf-b774-6375cfb6367e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:07.539090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f321eb0d-05d1-4dbf-b774-6375cfb6367e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.609753 Feb 21 00:37:07.541395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 57/92] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:06 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:07.550445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-865f43ab-ef4f-4fbb-a1db-600a65af7378 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:07.551607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:07.554706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-865f43ab-ef4f-4fbb-a1db-600a65af7378 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:07.569791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:07.571571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:07.573264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-72ada5cc-a681-4dc5-baae-5ec7e17f10b8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.253895 Feb 21 00:37:07.586351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 36/93] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:07 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:37:07.590165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-865f43ab-ef4f-4fbb-a1db-600a65af7378 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:07.590708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-865f43ab-ef4f-4fbb-a1db-600a65af7378 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:07.591707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-865f43ab-ef4f-4fbb-a1db-600a65af7378 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:07.592239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-865f43ab-ef4f-4fbb-a1db-600a65af7378 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:07.856917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-865f43ab-ef4f-4fbb-a1db-600a65af7378 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:07.869823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-865f43ab-ef4f-4fbb-a1db-600a65af7378 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.327138 Feb 21 00:37:07.870926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 58/94] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:07 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:07.992383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f41c8cd9-62f7-45ab-9113-9a6ebf026be3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:07.993742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f41c8cd9-62f7-45ab-9113-9a6ebf026be3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:08.006199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f41c8cd9-62f7-45ab-9113-9a6ebf026be3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:08.007812 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f41c8cd9-62f7-45ab-9113-9a6ebf026be3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:08.009766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f41c8cd9-62f7-45ab-9113-9a6ebf026be3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:08.010695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f41c8cd9-62f7-45ab-9113-9a6ebf026be3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:08.243557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f41c8cd9-62f7-45ab-9113-9a6ebf026be3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:08.264579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f41c8cd9-62f7-45ab-9113-9a6ebf026be3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.281784 Feb 21 00:37:08.265410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 37/95] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:07 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:08.557256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8547f8f1-cf81-468d-a4dc-425f90b02eca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:08.557967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8547f8f1-cf81-468d-a4dc-425f90b02eca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:08.578748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8547f8f1-cf81-468d-a4dc-425f90b02eca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:08.582863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8547f8f1-cf81-468d-a4dc-425f90b02eca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:08.583910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8547f8f1-cf81-468d-a4dc-425f90b02eca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:08.585511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8547f8f1-cf81-468d-a4dc-425f90b02eca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:08.592151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:08.593233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:08.606043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:08.611142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:08.612069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:08.619365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:08.911313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:08.921350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:08.922958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:08.924181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c5c98cbf-68f4-4d9f-be21-1c88d6a4a71f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.336160 Feb 21 00:37:08.924925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 38/96] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:37:08.938626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e56b4e71-e4d0-4bdb-839f-c38f97125a2e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:08.939262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e56b4e71-e4d0-4bdb-839f-c38f97125a2e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:08.953602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e56b4e71-e4d0-4bdb-839f-c38f97125a2e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:08.954540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e56b4e71-e4d0-4bdb-839f-c38f97125a2e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:08.957821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e56b4e71-e4d0-4bdb-839f-c38f97125a2e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:08.958319 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e56b4e71-e4d0-4bdb-839f-c38f97125a2e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:09.063692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8547f8f1-cf81-468d-a4dc-425f90b02eca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:09.072904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8547f8f1-cf81-468d-a4dc-425f90b02eca tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.519315 Feb 21 00:37:09.075305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 59/97] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:08 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:09.155642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e56b4e71-e4d0-4bdb-839f-c38f97125a2e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:09.167469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e56b4e71-e4d0-4bdb-839f-c38f97125a2e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.241158 Feb 21 00:37:09.168711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 39/98] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:08 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:09.290553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5b6aa673-9a77-4e5f-92d2-79bf1599d504 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:09.291688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5b6aa673-9a77-4e5f-92d2-79bf1599d504 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:09.300308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b6aa673-9a77-4e5f-92d2-79bf1599d504 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:09.301661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b6aa673-9a77-4e5f-92d2-79bf1599d504 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:09.302777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b6aa673-9a77-4e5f-92d2-79bf1599d504 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:09.303495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b6aa673-9a77-4e5f-92d2-79bf1599d504 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:09.561315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-d2191147-9d1f-4d18-835d-b439668665f4 req-0bb50c30-99bf-474e-a3bd-1259af60806e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bedd6d6-814a-48db-a1ca-b35b01e44759", "name": "network-vif-plugged", "status": "completed", "tag": "7d5e4a15-788e-4ca8-ab9b-4b2d972b4aa0"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:09.562381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5b6aa673-9a77-4e5f-92d2-79bf1599d504 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:09.563078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:37:09.563078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:37:09.573166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5b6aa673-9a77-4e5f-92d2-79bf1599d504 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.292114 Feb 21 00:37:09.575901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-d2191147-9d1f-4d18-835d-b439668665f4 req-0bb50c30-99bf-474e-a3bd-1259af60806e service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:09.576249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 60/99] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:09 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:09.576707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-d2191147-9d1f-4d18-835d-b439668665f4 req-0bb50c30-99bf-474e-a3bd-1259af60806e service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:09.592809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-d2191147-9d1f-4d18-835d-b439668665f4 req-0bb50c30-99bf-474e-a3bd-1259af60806e service nova] Creating event network-vif-plugged:7d5e4a15-788e-4ca8-ab9b-4b2d972b4aa0 for instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 on hv-cinder-81322 Feb 21 00:37:09.598547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-d2191147-9d1f-4d18-835d-b439668665f4 req-0bb50c30-99bf-474e-a3bd-1259af60806e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121409 Feb 21 00:37:09.599317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 40/100] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:09.942223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:09.942928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:09.953046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:09.953499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:09.954298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:09.954736 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:10.092175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-45662633-eebc-4c7c-8324-c4a00e56cfa6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:10.093039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-45662633-eebc-4c7c-8324-c4a00e56cfa6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:10.100496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45662633-eebc-4c7c-8324-c4a00e56cfa6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:10.101918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45662633-eebc-4c7c-8324-c4a00e56cfa6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:10.103072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45662633-eebc-4c7c-8324-c4a00e56cfa6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:10.103809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45662633-eebc-4c7c-8324-c4a00e56cfa6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:10.230401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:10.240813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:10.243889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:10.245673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9c53dc1d-c264-4263-b2fa-b1c1c8b37ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.307472 Feb 21 00:37:10.246658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 61/101] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:37:10.251338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-47f9bc35-21fb-4bbf-9ae8-c5f4e59cc1a8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:10.251902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-47f9bc35-21fb-4bbf-9ae8-c5f4e59cc1a8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:10.261135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47f9bc35-21fb-4bbf-9ae8-c5f4e59cc1a8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:10.261758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47f9bc35-21fb-4bbf-9ae8-c5f4e59cc1a8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:10.262656 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47f9bc35-21fb-4bbf-9ae8-c5f4e59cc1a8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:10.263105 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47f9bc35-21fb-4bbf-9ae8-c5f4e59cc1a8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:10.357394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-45662633-eebc-4c7c-8324-c4a00e56cfa6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:10.373030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-45662633-eebc-4c7c-8324-c4a00e56cfa6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.285404 Feb 21 00:37:10.373833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 41/102] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:10 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:10.423134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-47f9bc35-21fb-4bbf-9ae8-c5f4e59cc1a8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:10.430636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-47f9bc35-21fb-4bbf-9ae8-c5f4e59cc1a8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.182797 Feb 21 00:37:10.431206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 62/103] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:10 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:10.594889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3cd71be7-6e02-43fe-ac8d-5745486aed08 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:10.595889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3cd71be7-6e02-43fe-ac8d-5745486aed08 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:10.601983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cd71be7-6e02-43fe-ac8d-5745486aed08 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:10.602447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cd71be7-6e02-43fe-ac8d-5745486aed08 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:10.603248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cd71be7-6e02-43fe-ac8d-5745486aed08 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:10.603684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cd71be7-6e02-43fe-ac8d-5745486aed08 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:10.781752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3cd71be7-6e02-43fe-ac8d-5745486aed08 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:10.791836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3cd71be7-6e02-43fe-ac8d-5745486aed08 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.201655 Feb 21 00:37:10.792785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 42/104] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:10 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:11.264829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:11.266463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:11.275582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.276154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:11.277094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.277821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:11.390608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2ea4fff5-8f86-473d-a0da-0b30891dc67f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:11.391984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2ea4fff5-8f86-473d-a0da-0b30891dc67f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:11.399306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ea4fff5-8f86-473d-a0da-0b30891dc67f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.399559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ea4fff5-8f86-473d-a0da-0b30891dc67f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:11.400343 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ea4fff5-8f86-473d-a0da-0b30891dc67f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.400809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ea4fff5-8f86-473d-a0da-0b30891dc67f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:11.552689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:11.562018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:11.565707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:11.568125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1ba328a7-9e52-444b-8a63-93536c07cbb6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.307712 Feb 21 00:37:11.568976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 63/105] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:37:11.573715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8ad1e41a-9582-420c-809e-5a63a5f1f58c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:11.574318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8ad1e41a-9582-420c-809e-5a63a5f1f58c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:11.580341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8ad1e41a-9582-420c-809e-5a63a5f1f58c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.580800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8ad1e41a-9582-420c-809e-5a63a5f1f58c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:11.581577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8ad1e41a-9582-420c-809e-5a63a5f1f58c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.582010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8ad1e41a-9582-420c-809e-5a63a5f1f58c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:11.674631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2ea4fff5-8f86-473d-a0da-0b30891dc67f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:11.690127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2ea4fff5-8f86-473d-a0da-0b30891dc67f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.304212 Feb 21 00:37:11.690711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 43/106] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:11 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:11.695718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-aac4996e-378d-4195-9075-1db24c515fcc req-3569de9e-79a8-48ba-8899-312c874b0c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fdd17-aabc-46ec-b8eb-1611ca351b02", "name": "network-vif-plugged", "status": "completed", "tag": "e67eb7bd-3133-41a3-bc80-324738730e42"}, {"server_uuid": "d637a83e-8fb7-4b8c-b617-e8d245844ee2", "name": "network-vif-plugged", "status": "completed", "tag": "1cd9b49c-50c7-4d52-af67-9e9f7f069840"}, {"server_uuid": "2482a368-86ed-4e3c-aa3d-e414ae527066", "name": "network-vif-plugged", "status": "completed", "tag": "3e28f716-bca9-4286-8b93-1948b2352ec2"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:11.697903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:37:11.697903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:37:11.707001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-aac4996e-378d-4195-9075-1db24c515fcc req-3569de9e-79a8-48ba-8899-312c874b0c10 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.707457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-aac4996e-378d-4195-9075-1db24c515fcc req-3569de9e-79a8-48ba-8899-312c874b0c10 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:11.722280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-aac4996e-378d-4195-9075-1db24c515fcc req-3569de9e-79a8-48ba-8899-312c874b0c10 service nova] Creating event network-vif-plugged:e67eb7bd-3133-41a3-bc80-324738730e42 for instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 on hv-cinder-81322 Feb 21 00:37:11.722779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-aac4996e-378d-4195-9075-1db24c515fcc req-3569de9e-79a8-48ba-8899-312c874b0c10 service nova] Creating event network-vif-plugged:1cd9b49c-50c7-4d52-af67-9e9f7f069840 for instance d637a83e-8fb7-4b8c-b617-e8d245844ee2 on hv-cinder-81322 Feb 21 00:37:11.723269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-aac4996e-378d-4195-9075-1db24c515fcc req-3569de9e-79a8-48ba-8899-312c874b0c10 service nova] Creating event network-vif-plugged:3e28f716-bca9-4286-8b93-1948b2352ec2 for instance 2482a368-86ed-4e3c-aa3d-e414ae527066 on hv-cinder-81322 Feb 21 00:37:11.735144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-aac4996e-378d-4195-9075-1db24c515fcc req-3569de9e-79a8-48ba-8899-312c874b0c10 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043105 Feb 21 00:37:11.740648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 44/107] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:11.762948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8ad1e41a-9582-420c-809e-5a63a5f1f58c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:11.771244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8ad1e41a-9582-420c-809e-5a63a5f1f58c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.200806 Feb 21 00:37:11.780952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 64/108] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:11 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:11.809606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d7da88d4-5a1c-430f-9a64-26ba5b539fc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:11.810438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d7da88d4-5a1c-430f-9a64-26ba5b539fc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:11.824753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7da88d4-5a1c-430f-9a64-26ba5b539fc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.825174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7da88d4-5a1c-430f-9a64-26ba5b539fc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:11.826113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7da88d4-5a1c-430f-9a64-26ba5b539fc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:11.826674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7da88d4-5a1c-430f-9a64-26ba5b539fc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:12.115089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d7da88d4-5a1c-430f-9a64-26ba5b539fc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:12.130016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d7da88d4-5a1c-430f-9a64-26ba5b539fc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.324507 Feb 21 00:37:12.131351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 45/109] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:11 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:12.591281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:12.592031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:12.600841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:12.601366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:12.602793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:12.603842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:12.707528 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5cb8ff5a-c734-4599-911c-0fa26817f839 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:12.708143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5cb8ff5a-c734-4599-911c-0fa26817f839 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:12.716852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cb8ff5a-c734-4599-911c-0fa26817f839 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:12.723157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cb8ff5a-c734-4599-911c-0fa26817f839 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:12.724335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cb8ff5a-c734-4599-911c-0fa26817f839 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:12.726500 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cb8ff5a-c734-4599-911c-0fa26817f839 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:12.810719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:12.821957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:12.823692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:12.825011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-abfc0202-e958-4f82-82f6-fa82e44dd077 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.243014 Feb 21 00:37:12.826177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 65/110] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:12.832065 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f6614e58-765a-4162-99b8-7298851a4723 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:12.833012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f6614e58-765a-4162-99b8-7298851a4723 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:12.839992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6614e58-765a-4162-99b8-7298851a4723 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:12.840833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6614e58-765a-4162-99b8-7298851a4723 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:12.842328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6614e58-765a-4162-99b8-7298851a4723 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:12.842866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6614e58-765a-4162-99b8-7298851a4723 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:12.928067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5cb8ff5a-c734-4599-911c-0fa26817f839 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:12.935939 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5cb8ff5a-c734-4599-911c-0fa26817f839 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.232861 Feb 21 00:37:12.937334 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 46/111] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:12 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:12.996029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f6614e58-765a-4162-99b8-7298851a4723 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:13.003446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f6614e58-765a-4162-99b8-7298851a4723 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.175891 Feb 21 00:37:13.004123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 66/112] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:12 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:13.146814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ae1df8dd-5b36-416d-8c34-62a071529080 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:13.147536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ae1df8dd-5b36-416d-8c34-62a071529080 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:13.153714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae1df8dd-5b36-416d-8c34-62a071529080 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:13.154061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae1df8dd-5b36-416d-8c34-62a071529080 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:13.155651 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae1df8dd-5b36-416d-8c34-62a071529080 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:13.156793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae1df8dd-5b36-416d-8c34-62a071529080 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:13.297804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ae1df8dd-5b36-416d-8c34-62a071529080 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:13.305821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ae1df8dd-5b36-416d-8c34-62a071529080 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.162899 Feb 21 00:37:13.306386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 47/113] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:13 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:13.843190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:13.843911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:13.850448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:13.850981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:13.852075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:13.852593 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:13.954169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-35690f8d-3283-4052-b90a-0dd47313419e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:13.954857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-35690f8d-3283-4052-b90a-0dd47313419e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:13.961749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35690f8d-3283-4052-b90a-0dd47313419e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:13.962520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35690f8d-3283-4052-b90a-0dd47313419e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:13.967088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35690f8d-3283-4052-b90a-0dd47313419e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:13.968303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35690f8d-3283-4052-b90a-0dd47313419e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:13.992060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:14.000371 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:14.002328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:14.003437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7893b974-c423-4ac6-84e5-83be5881545b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.164274 Feb 21 00:37:14.004002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 67/114] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:14.019592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-546ad932-73d9-4488-832d-8ded23ee0c19 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:14.020728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-546ad932-73d9-4488-832d-8ded23ee0c19 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:14.026817 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-546ad932-73d9-4488-832d-8ded23ee0c19 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:14.027268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-546ad932-73d9-4488-832d-8ded23ee0c19 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:14.028060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-546ad932-73d9-4488-832d-8ded23ee0c19 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:14.028530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-546ad932-73d9-4488-832d-8ded23ee0c19 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:14.165809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-35690f8d-3283-4052-b90a-0dd47313419e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:14.176333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-35690f8d-3283-4052-b90a-0dd47313419e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.226164 Feb 21 00:37:14.176958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 48/115] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:13 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:14.188273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-546ad932-73d9-4488-832d-8ded23ee0c19 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:14.196404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-546ad932-73d9-4488-832d-8ded23ee0c19 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.180416 Feb 21 00:37:14.197116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 68/116] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:14 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:14.323273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-953f315e-efa8-471d-8fee-e85bbb100755 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:14.323950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-953f315e-efa8-471d-8fee-e85bbb100755 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:14.331213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-953f315e-efa8-471d-8fee-e85bbb100755 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:14.331750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-953f315e-efa8-471d-8fee-e85bbb100755 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:14.332837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-953f315e-efa8-471d-8fee-e85bbb100755 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:14.333329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-953f315e-efa8-471d-8fee-e85bbb100755 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:14.477150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-953f315e-efa8-471d-8fee-e85bbb100755 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:14.484379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-953f315e-efa8-471d-8fee-e85bbb100755 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.164951 Feb 21 00:37:14.484974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 49/117] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:14 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:15.021218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:15.021811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:15.027907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:15.028335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:15.029330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:15.029755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:15.173707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:15.182756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:15.184400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:15.185731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1a44bcb8-c357-41e4-a216-960aac33a0b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.168260 Feb 21 00:37:15.186472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 69/118] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:15.192464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9b351917-b35d-43cd-b42c-66f41a2c6be1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:15.193626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9b351917-b35d-43cd-b42c-66f41a2c6be1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:15.200679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9b351917-b35d-43cd-b42c-66f41a2c6be1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:15.201156 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9b351917-b35d-43cd-b42c-66f41a2c6be1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:15.202018 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9b351917-b35d-43cd-b42c-66f41a2c6be1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:15.202349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9b351917-b35d-43cd-b42c-66f41a2c6be1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:15.213621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-664395c2-008f-4acf-97aa-378badf6adf0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:15.214653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-664395c2-008f-4acf-97aa-378badf6adf0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:15.221365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-664395c2-008f-4acf-97aa-378badf6adf0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:15.221895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-664395c2-008f-4acf-97aa-378badf6adf0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:15.222897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-664395c2-008f-4acf-97aa-378badf6adf0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:15.223345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-664395c2-008f-4acf-97aa-378badf6adf0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:15.357964 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9b351917-b35d-43cd-b42c-66f41a2c6be1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:15.368552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9b351917-b35d-43cd-b42c-66f41a2c6be1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.176732 Feb 21 00:37:15.368552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 50/119] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:15 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:15.368744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-664395c2-008f-4acf-97aa-378badf6adf0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:15.375050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-664395c2-008f-4acf-97aa-378badf6adf0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.165325 Feb 21 00:37:15.375602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 70/120] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:15 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:15.510408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-18db7779-7892-4b43-a937-051fc5054b7a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:15.510408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-18db7779-7892-4b43-a937-051fc5054b7a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:15.510408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-18db7779-7892-4b43-a937-051fc5054b7a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:15.510408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-18db7779-7892-4b43-a937-051fc5054b7a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:15.510710 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-18db7779-7892-4b43-a937-051fc5054b7a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:15.510710 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-18db7779-7892-4b43-a937-051fc5054b7a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:15.641045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-18db7779-7892-4b43-a937-051fc5054b7a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:15.648177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-18db7779-7892-4b43-a937-051fc5054b7a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.151405 Feb 21 00:37:15.648762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 51/121] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:15 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:16.202698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:16.203272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:16.209480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:16.209902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:16.210709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:16.212316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:16.355315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:16.371435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:16.373196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:16.374334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4569335e-99c1-4ce6-97eb-ad402ced85bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.175485 Feb 21 00:37:16.374877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 71/122] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:16.389180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e8e195a8-4f65-47c2-8c38-0da49b4eba40 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:16.389852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e8e195a8-4f65-47c2-8c38-0da49b4eba40 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:16.391332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3e141700-59ab-4f1b-bc09-ee7f8d71ffdf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:16.391975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3e141700-59ab-4f1b-bc09-ee7f8d71ffdf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:16.395994 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8e195a8-4f65-47c2-8c38-0da49b4eba40 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:16.396465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8e195a8-4f65-47c2-8c38-0da49b4eba40 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:16.397248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8e195a8-4f65-47c2-8c38-0da49b4eba40 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:16.397675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8e195a8-4f65-47c2-8c38-0da49b4eba40 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:16.398739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3e141700-59ab-4f1b-bc09-ee7f8d71ffdf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:16.399183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3e141700-59ab-4f1b-bc09-ee7f8d71ffdf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:16.399955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3e141700-59ab-4f1b-bc09-ee7f8d71ffdf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:16.400380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3e141700-59ab-4f1b-bc09-ee7f8d71ffdf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:16.544836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3e141700-59ab-4f1b-bc09-ee7f8d71ffdf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:16.552167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3e141700-59ab-4f1b-bc09-ee7f8d71ffdf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.164827 Feb 21 00:37:16.552959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 72/123] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:16 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:16.561816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8e195a8-4f65-47c2-8c38-0da49b4eba40 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:16.569517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e8e195a8-4f65-47c2-8c38-0da49b4eba40 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.184038 Feb 21 00:37:16.570201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 52/124] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:16 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:16.664712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9dbafe54-eac8-40bd-9dac-ea74ed3b08f9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:16.665317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9dbafe54-eac8-40bd-9dac-ea74ed3b08f9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:16.671215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9dbafe54-eac8-40bd-9dac-ea74ed3b08f9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:16.671658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9dbafe54-eac8-40bd-9dac-ea74ed3b08f9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:16.672428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9dbafe54-eac8-40bd-9dac-ea74ed3b08f9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:16.672863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9dbafe54-eac8-40bd-9dac-ea74ed3b08f9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:16.811150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9dbafe54-eac8-40bd-9dac-ea74ed3b08f9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:16.819931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9dbafe54-eac8-40bd-9dac-ea74ed3b08f9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.158888 Feb 21 00:37:16.820565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 73/125] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:16 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:17.391072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:17.391543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:17.398665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:17.399164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:17.399938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:17.400370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:17.550138 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:17.558020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:17.559507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:17.561023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0850f9dd-887c-42f9-8ba9-6ecae287d842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.173874 Feb 21 00:37:17.561597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 53/126] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:17 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:17.568575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-75e2ebdb-c49f-490c-83c9-d53977958f1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:17.569927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-75e2ebdb-c49f-490c-83c9-d53977958f1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:17.576673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75e2ebdb-c49f-490c-83c9-d53977958f1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:17.577187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75e2ebdb-c49f-490c-83c9-d53977958f1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:17.578030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75e2ebdb-c49f-490c-83c9-d53977958f1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:17.578519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75e2ebdb-c49f-490c-83c9-d53977958f1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:17.586275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a386885a-a283-4c10-9ec8-9ced02b3fab1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:17.589300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a386885a-a283-4c10-9ec8-9ced02b3fab1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:17.597470 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a386885a-a283-4c10-9ec8-9ced02b3fab1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:17.598019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a386885a-a283-4c10-9ec8-9ced02b3fab1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:17.598974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a386885a-a283-4c10-9ec8-9ced02b3fab1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:17.599467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a386885a-a283-4c10-9ec8-9ced02b3fab1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:17.719768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-75e2ebdb-c49f-490c-83c9-d53977958f1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:17.731779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-75e2ebdb-c49f-490c-83c9-d53977958f1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.166729 Feb 21 00:37:17.732803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 74/127] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:17 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:17.775330 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a386885a-a283-4c10-9ec8-9ced02b3fab1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:17.782876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a386885a-a283-4c10-9ec8-9ced02b3fab1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.200533 Feb 21 00:37:17.783782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 54/128] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:17 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:17.836234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-84aaa928-d974-4b63-b15b-c73a74c86103 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:17.837015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-84aaa928-d974-4b63-b15b-c73a74c86103 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:17.843647 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84aaa928-d974-4b63-b15b-c73a74c86103 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:17.844187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84aaa928-d974-4b63-b15b-c73a74c86103 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:17.845147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84aaa928-d974-4b63-b15b-c73a74c86103 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:17.845676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84aaa928-d974-4b63-b15b-c73a74c86103 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:17.997196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-84aaa928-d974-4b63-b15b-c73a74c86103 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:18.007366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-84aaa928-d974-4b63-b15b-c73a74c86103 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.175439 Feb 21 00:37:18.007934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 75/129] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:17 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:18.579816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:18.580666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:18.586743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:18.587254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:18.588089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:18.588632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:18.726151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:18.734365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:18.735723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:18.736842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-728dc363-2199-4d9a-9341-5028102ed64f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.160955 Feb 21 00:37:18.737408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 55/130] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:18.752001 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-37d82553-cc0c-4364-b413-024cf9bd2c06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:18.752658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-37d82553-cc0c-4364-b413-024cf9bd2c06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:18.759184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37d82553-cc0c-4364-b413-024cf9bd2c06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:18.759732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37d82553-cc0c-4364-b413-024cf9bd2c06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:18.760735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37d82553-cc0c-4364-b413-024cf9bd2c06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:18.761166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37d82553-cc0c-4364-b413-024cf9bd2c06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:18.798845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3f9ef510-43a9-466b-970d-3c07a2fcfcd5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:18.799390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3f9ef510-43a9-466b-970d-3c07a2fcfcd5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:18.806703 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f9ef510-43a9-466b-970d-3c07a2fcfcd5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:18.807146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f9ef510-43a9-466b-970d-3c07a2fcfcd5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:18.807929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f9ef510-43a9-466b-970d-3c07a2fcfcd5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:18.808362 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f9ef510-43a9-466b-970d-3c07a2fcfcd5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:18.899365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-37d82553-cc0c-4364-b413-024cf9bd2c06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:18.906885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-37d82553-cc0c-4364-b413-024cf9bd2c06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.159445 Feb 21 00:37:18.907518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 76/131] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:18 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:18.941591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3f9ef510-43a9-466b-970d-3c07a2fcfcd5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:18.949208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3f9ef510-43a9-466b-970d-3c07a2fcfcd5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.153948 Feb 21 00:37:18.949793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 56/132] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:18 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:19.023509 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce31543c-c2f0-46c1-8f6e-4cc07d14886b tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:19.024152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce31543c-c2f0-46c1-8f6e-4cc07d14886b tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:19.030393 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce31543c-c2f0-46c1-8f6e-4cc07d14886b tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:19.030839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce31543c-c2f0-46c1-8f6e-4cc07d14886b tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:19.031705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce31543c-c2f0-46c1-8f6e-4cc07d14886b tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:19.032084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce31543c-c2f0-46c1-8f6e-4cc07d14886b tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:19.169032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce31543c-c2f0-46c1-8f6e-4cc07d14886b tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:19.176378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce31543c-c2f0-46c1-8f6e-4cc07d14886b tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1314 microversion: 2.1 time: 0.156700 Feb 21 00:37:19.176974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 77/133] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:19 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:19.755308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:19.756689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:19.762942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:19.763379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:19.764150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:19.764613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:19.909798 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:19.918685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:19.921320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:19.922550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-75a1af4c-9477-435a-8c21-5ffc05caae9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.170965 Feb 21 00:37:19.923256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 57/134] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:19.924438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-051e57b8-e911-440e-a998-3a1215ebba67 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:19.925162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-051e57b8-e911-440e-a998-3a1215ebba67 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:19.931315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-051e57b8-e911-440e-a998-3a1215ebba67 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:19.931792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-051e57b8-e911-440e-a998-3a1215ebba67 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:19.932654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-051e57b8-e911-440e-a998-3a1215ebba67 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:19.933314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-051e57b8-e911-440e-a998-3a1215ebba67 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:19.965296 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8a020786-05b0-4095-aa75-f8ad7c712449 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:19.965921 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8a020786-05b0-4095-aa75-f8ad7c712449 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:19.971892 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a020786-05b0-4095-aa75-f8ad7c712449 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:19.972339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a020786-05b0-4095-aa75-f8ad7c712449 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:19.973924 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a020786-05b0-4095-aa75-f8ad7c712449 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:19.973924 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a020786-05b0-4095-aa75-f8ad7c712449 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:20.078264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-051e57b8-e911-440e-a998-3a1215ebba67 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:20.085550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-051e57b8-e911-440e-a998-3a1215ebba67 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1361 microversion: 2.1 time: 0.165061 Feb 21 00:37:20.086122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 78/135] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:19 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:20.126810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8a020786-05b0-4095-aa75-f8ad7c712449 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:20.134977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8a020786-05b0-4095-aa75-f8ad7c712449 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1322 microversion: 2.1 time: 0.173374 Feb 21 00:37:20.135661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 58/136] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:19 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:37:20.192620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1050b911-d2af-4e7e-b1cd-83295ed426fe tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:20.193226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1050b911-d2af-4e7e-b1cd-83295ed426fe tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:20.199158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1050b911-d2af-4e7e-b1cd-83295ed426fe tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:20.199601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1050b911-d2af-4e7e-b1cd-83295ed426fe tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:20.200368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1050b911-d2af-4e7e-b1cd-83295ed426fe tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:20.200924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1050b911-d2af-4e7e-b1cd-83295ed426fe tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:20.349337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1050b911-d2af-4e7e-b1cd-83295ed426fe tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:20.358220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1050b911-d2af-4e7e-b1cd-83295ed426fe tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1500 microversion: 2.1 time: 0.169225 Feb 21 00:37:20.358799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 79/137] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:20 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:20.940157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:20.940811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:20.947233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:20.947671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:20.948471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:20.948893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.080159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:21.087927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:21.089432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:21.090521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ad4015a-f183-46b0-890e-779b6e29e7dc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.154111 Feb 21 00:37:21.091083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 59/138] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:21.102960 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-de595d3d-b7c6-4603-aabe-71810263d17f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:21.103569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-de595d3d-b7c6-4603-aabe-71810263d17f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:21.110390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de595d3d-b7c6-4603-aabe-71810263d17f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.110777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de595d3d-b7c6-4603-aabe-71810263d17f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.111584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de595d3d-b7c6-4603-aabe-71810263d17f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.112017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de595d3d-b7c6-4603-aabe-71810263d17f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.153515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9d697e63-b280-4a32-860e-b463875bea19 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:21.154759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9d697e63-b280-4a32-860e-b463875bea19 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:21.162715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d697e63-b280-4a32-860e-b463875bea19 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.163599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d697e63-b280-4a32-860e-b463875bea19 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.164519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d697e63-b280-4a32-860e-b463875bea19 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.165066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d697e63-b280-4a32-860e-b463875bea19 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.260115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-de595d3d-b7c6-4603-aabe-71810263d17f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:21.267634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-de595d3d-b7c6-4603-aabe-71810263d17f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1546 microversion: 2.1 time: 0.168370 Feb 21 00:37:21.268206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 80/139] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:21 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:21.284088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2c9e9976-e6e5-494a-aed1-0340c340f328 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:21.284599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2c9e9976-e6e5-494a-aed1-0340c340f328 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:21.290569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2c9e9976-e6e5-494a-aed1-0340c340f328 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.291004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2c9e9976-e6e5-494a-aed1-0340c340f328 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.291760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2c9e9976-e6e5-494a-aed1-0340c340f328 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.292182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2c9e9976-e6e5-494a-aed1-0340c340f328 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.303355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9d697e63-b280-4a32-860e-b463875bea19 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:21.311020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9d697e63-b280-4a32-860e-b463875bea19 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1515 microversion: 2.1 time: 0.162608 Feb 21 00:37:21.311556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 60/140] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:21 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:21.327541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7bcf0127-a500-4418-a650-082afc6dfc67 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:21.328564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7bcf0127-a500-4418-a650-082afc6dfc67 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:21.334229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7bcf0127-a500-4418-a650-082afc6dfc67 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.334672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7bcf0127-a500-4418-a650-082afc6dfc67 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.335438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7bcf0127-a500-4418-a650-082afc6dfc67 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.335867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7bcf0127-a500-4418-a650-082afc6dfc67 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.398854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-7bcf0127-a500-4418-a650-082afc6dfc67 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lazy-loading 'flavor' on Instance uuid d637a83e-8fb7-4b8c-b617-e8d245844ee2 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:37:21.557199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2c9e9976-e6e5-494a-aed1-0340c340f328 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276486 Feb 21 00:37:21.557798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 81/141] 10.222.0.72 () {58 vars in 1274 bytes} [Mon Feb 21 00:37:21 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:37:21.679128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7bcf0127-a500-4418-a650-082afc6dfc67 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2/action" status: 200 len: 32 microversion: 2.1 time: 0.355120 Feb 21 00:37:21.680072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 61/142] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:37:21 2022] POST /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2/action => generated 32 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 00:37:21.688719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-645b4a26-1fb7-4a40-a4e0-157f3970be17 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:21.689677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-645b4a26-1fb7-4a40-a4e0-157f3970be17 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:21.696190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-645b4a26-1fb7-4a40-a4e0-157f3970be17 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.696782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-645b4a26-1fb7-4a40-a4e0-157f3970be17 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.697713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-645b4a26-1fb7-4a40-a4e0-157f3970be17 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:21.698143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-645b4a26-1fb7-4a40-a4e0-157f3970be17 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:21.957108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-645b4a26-1fb7-4a40-a4e0-157f3970be17 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:21.964987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-645b4a26-1fb7-4a40-a4e0-157f3970be17 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.279856 Feb 21 00:37:21.965554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 82/143] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:21 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:22.108519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:22.109303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:22.116643 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:22.117180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:22.118076 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:22.118596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:22.257437 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:22.265395 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:22.266969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:22.268295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d67692e9-c303-4474-942d-cda0471ad2e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.164179 Feb 21 00:37:22.268993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 62/144] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:22.982290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d74664ce-823e-4405-b0de-3241c607bc8f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:22.983374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d74664ce-823e-4405-b0de-3241c607bc8f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:22.990271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d74664ce-823e-4405-b0de-3241c607bc8f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:22.990815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d74664ce-823e-4405-b0de-3241c607bc8f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:22.994205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d74664ce-823e-4405-b0de-3241c607bc8f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:22.994205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d74664ce-823e-4405-b0de-3241c607bc8f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:22.999944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1fcf89f4-b90d-4fdb-8005-93b6b5629230 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:23.000558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1fcf89f4-b90d-4fdb-8005-93b6b5629230 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:23.006880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1fcf89f4-b90d-4fdb-8005-93b6b5629230 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:23.007394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1fcf89f4-b90d-4fdb-8005-93b6b5629230 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:23.008230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1fcf89f4-b90d-4fdb-8005-93b6b5629230 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:23.008738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1fcf89f4-b90d-4fdb-8005-93b6b5629230 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:23.032510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1fcf89f4-b90d-4fdb-8005-93b6b5629230 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/ips" status: 200 len: 105 microversion: 2.1 time: 0.036691 Feb 21 00:37:23.044567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 63/145] 10.222.0.72 () {58 vars in 1247 bytes} [Mon Feb 21 00:37:22 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/ips => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:23.050143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-bfefe889-40a2-4e2f-bba9-df8f8f52a9f2 req-f138fb0b-a535-4739-96c2-af251e51f02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2482a368-86ed-4e3c-aa3d-e414ae527066", "tag": "3e28f716-bca9-4286-8b93-1948b2352ec2"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:23.050143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:37:23.050143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:37:23.059780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-bfefe889-40a2-4e2f-bba9-df8f8f52a9f2 req-f138fb0b-a535-4739-96c2-af251e51f02a service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:23.060324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-bfefe889-40a2-4e2f-bba9-df8f8f52a9f2 req-f138fb0b-a535-4739-96c2-af251e51f02a service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:23.071884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-bfefe889-40a2-4e2f-bba9-df8f8f52a9f2 req-f138fb0b-a535-4739-96c2-af251e51f02a service nova] Creating event network-changed:3e28f716-bca9-4286-8b93-1948b2352ec2 for instance 2482a368-86ed-4e3c-aa3d-e414ae527066 on hv-cinder-81322 Feb 21 00:37:23.077080 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-bfefe889-40a2-4e2f-bba9-df8f8f52a9f2 req-f138fb0b-a535-4739-96c2-af251e51f02a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042860 Feb 21 00:37:23.078145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 64/146] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:23.148525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d74664ce-823e-4405-b0de-3241c607bc8f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:23.156090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d74664ce-823e-4405-b0de-3241c607bc8f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.177578 Feb 21 00:37:23.156778 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 83/147] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:22 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:23.286378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:23.286999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:23.299819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:23.299819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:23.299819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:23.299819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:23.363917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-f97494a4-0c2e-416c-8feb-d44f5243b529 req-12f35adf-eafd-4bdf-85fb-4ce1910dee23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aa3b9a-864e-42ff-81ec-278e00ddd8be", "name": "network-vif-plugged", "status": "completed", "tag": "d8dbce75-bbb2-4b0b-bc43-c864b59621e9"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:23.365939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:37:23.365939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:37:23.373769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-f97494a4-0c2e-416c-8feb-d44f5243b529 req-12f35adf-eafd-4bdf-85fb-4ce1910dee23 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:23.374329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-f97494a4-0c2e-416c-8feb-d44f5243b529 req-12f35adf-eafd-4bdf-85fb-4ce1910dee23 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:23.386503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-f97494a4-0c2e-416c-8feb-d44f5243b529 req-12f35adf-eafd-4bdf-85fb-4ce1910dee23 service nova] Creating event network-vif-plugged:d8dbce75-bbb2-4b0b-bc43-c864b59621e9 for instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be on hv-cinder-81322 Feb 21 00:37:23.392575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-f97494a4-0c2e-416c-8feb-d44f5243b529 req-12f35adf-eafd-4bdf-85fb-4ce1910dee23 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Feb 21 00:37:23.393358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 84/148] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:23.441522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:23.449662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:23.451412 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:23.452535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fb87146b-400f-46ed-a54e-45e50ebef575 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.170139 Feb 21 00:37:23.453108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 65/149] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:24.173797 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e71d28cf-ae4a-43fa-ac47-c87bb51df243 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:24.174494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e71d28cf-ae4a-43fa-ac47-c87bb51df243 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:24.180980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e71d28cf-ae4a-43fa-ac47-c87bb51df243 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:24.181420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e71d28cf-ae4a-43fa-ac47-c87bb51df243 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:24.182180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e71d28cf-ae4a-43fa-ac47-c87bb51df243 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:24.182603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e71d28cf-ae4a-43fa-ac47-c87bb51df243 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:24.323507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e71d28cf-ae4a-43fa-ac47-c87bb51df243 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:24.330747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e71d28cf-ae4a-43fa-ac47-c87bb51df243 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.161127 Feb 21 00:37:24.331314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 85/150] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:24 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:24.475816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:24.477068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:24.485577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:24.486016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:24.486788 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:24.487212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:24.623740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:24.631446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:24.632947 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:24.634030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4867d8fd-6508-4961-87d0-781c2cf0f352 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.166367 Feb 21 00:37:24.634563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 66/151] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:25.350829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1f0e2914-d43e-4101-b2ef-24a39ca5c031 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:25.351776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1f0e2914-d43e-4101-b2ef-24a39ca5c031 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:25.360520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1f0e2914-d43e-4101-b2ef-24a39ca5c031 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:25.360968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1f0e2914-d43e-4101-b2ef-24a39ca5c031 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:25.361747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1f0e2914-d43e-4101-b2ef-24a39ca5c031 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:25.362178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1f0e2914-d43e-4101-b2ef-24a39ca5c031 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:25.500217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1f0e2914-d43e-4101-b2ef-24a39ca5c031 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:25.508501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1f0e2914-d43e-4101-b2ef-24a39ca5c031 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.163876 Feb 21 00:37:25.509051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 86/152] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:25 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:25.654379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:25.655261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:25.664262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:25.664758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:25.665534 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:25.665971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:26.082964 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:26.094002 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:26.095769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:26.097464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f8ee82a8-afde-42a8-92ee-962c54442ce9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.447513 Feb 21 00:37:26.098283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 67/153] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:26.528725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5bd66a21-a539-45cd-a990-a248cebf4fb2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:26.529829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5bd66a21-a539-45cd-a990-a248cebf4fb2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:26.537652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bd66a21-a539-45cd-a990-a248cebf4fb2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:26.538653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bd66a21-a539-45cd-a990-a248cebf4fb2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:26.539663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bd66a21-a539-45cd-a990-a248cebf4fb2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:26.540151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bd66a21-a539-45cd-a990-a248cebf4fb2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:26.826303 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5bd66a21-a539-45cd-a990-a248cebf4fb2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:26.834044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5bd66a21-a539-45cd-a990-a248cebf4fb2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.311641 Feb 21 00:37:26.834633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 87/154] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:26 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:27.118375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:27.118942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:27.125212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:27.125659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:27.126429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:27.126863 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:27.265303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:27.273051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:27.274556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:27.275650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-32d19ca6-4f77-45b3-9e70-182a9cd302c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.161243 Feb 21 00:37:27.276256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 68/155] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:27.854744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-48f8a018-4855-4adc-9587-97b6a69731d1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:27.856314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-48f8a018-4855-4adc-9587-97b6a69731d1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:27.866431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48f8a018-4855-4adc-9587-97b6a69731d1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:27.867150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48f8a018-4855-4adc-9587-97b6a69731d1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:27.868447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48f8a018-4855-4adc-9587-97b6a69731d1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:27.869173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48f8a018-4855-4adc-9587-97b6a69731d1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:28.045536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-48f8a018-4855-4adc-9587-97b6a69731d1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:28.052072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ef0a617-b723-40a2-a9b4-b9097fa5ead1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c594732-6adc-44a3-a86d-aaf77fd5e86a"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:28.053142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-48f8a018-4855-4adc-9587-97b6a69731d1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.204576 Feb 21 00:37:28.053627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6ef0a617-b723-40a2-a9b4-b9097fa5ead1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:28.062035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ef0a617-b723-40a2-a9b4-b9097fa5ead1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:28.062035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ef0a617-b723-40a2-a9b4-b9097fa5ead1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:28.062035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ef0a617-b723-40a2-a9b4-b9097fa5ead1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:28.062035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ef0a617-b723-40a2-a9b4-b9097fa5ead1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:28.063479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 88/156] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:27 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:28.294099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:28.295047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:28.303133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:28.307310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:28.308383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:28.309066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:28.429492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ef0a617-b723-40a2-a9b4-b9097fa5ead1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "POST /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381383 Feb 21 00:37:28.434630 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 69/157] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 00:37:28 2022] POST /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:37:28.456995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:28.466864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:28.468629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:28.470529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-214edfef-d878-475d-aa39-0c9718e7670c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1407 microversion: 2.20 time: 0.180227 Feb 21 00:37:28.471532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 89/158] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:29.070871 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7637002e-1119-47e1-86be-aec157ffab70 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:29.071558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7637002e-1119-47e1-86be-aec157ffab70 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:29.077694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7637002e-1119-47e1-86be-aec157ffab70 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:29.078131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7637002e-1119-47e1-86be-aec157ffab70 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:29.078890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7637002e-1119-47e1-86be-aec157ffab70 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:29.079306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7637002e-1119-47e1-86be-aec157ffab70 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:29.222145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7637002e-1119-47e1-86be-aec157ffab70 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:29.229720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7637002e-1119-47e1-86be-aec157ffab70 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.163185 Feb 21 00:37:29.230539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 70/159] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:29 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:29.489541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:29.490292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:29.510945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:29.511524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:29.512365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:29.512815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:29.661565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:29.673753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:29.675488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:29.677093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c913b343-9b46-407f-b375-23f4e4e9421b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1600 microversion: 2.20 time: 0.191962 Feb 21 00:37:29.682970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 90/160] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:37:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1600 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:37:29.694241 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c2405530-d9e9-4f02-a2e5-6895953306df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:29.695261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c2405530-d9e9-4f02-a2e5-6895953306df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:29.701376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2405530-d9e9-4f02-a2e5-6895953306df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:29.701936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2405530-d9e9-4f02-a2e5-6895953306df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:29.702876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2405530-d9e9-4f02-a2e5-6895953306df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:29.703299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2405530-d9e9-4f02-a2e5-6895953306df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:29.786799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c2405530-d9e9-4f02-a2e5-6895953306df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096191 Feb 21 00:37:29.787401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 71/161] 10.222.0.72 () {60 vars in 1315 bytes} [Mon Feb 21 00:37:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:37:30.246832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e7d75359-e148-4e70-bd65-203b0c28ca00 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:30.247612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e7d75359-e148-4e70-bd65-203b0c28ca00 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:30.254437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7d75359-e148-4e70-bd65-203b0c28ca00 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:30.255856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7d75359-e148-4e70-bd65-203b0c28ca00 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:30.257728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7d75359-e148-4e70-bd65-203b0c28ca00 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:30.258350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7d75359-e148-4e70-bd65-203b0c28ca00 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:30.419864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e7d75359-e148-4e70-bd65-203b0c28ca00 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:30.428163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e7d75359-e148-4e70-bd65-203b0c28ca00 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.185632 Feb 21 00:37:30.428881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 91/162] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:30 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:31.286879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-2aef6d17-f17a-404a-8a0a-7a7f81c00534 req-8aff4c33-f042-488a-b301-f2618dd8ee31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5aa3b9a-864e-42ff-81ec-278e00ddd8be", "tag": "d8dbce75-bbb2-4b0b-bc43-c864b59621e9"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:37:31.289246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4735e514-4704-4394-a83d-3ec633a3a808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:31.289860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4735e514-4704-4394-a83d-3ec633a3a808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:31.290285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:37:31.290285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:37:31.298175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4735e514-4704-4394-a83d-3ec633a3a808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:31.298839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4735e514-4704-4394-a83d-3ec633a3a808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:31.299124 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-2aef6d17-f17a-404a-8a0a-7a7f81c00534 req-8aff4c33-f042-488a-b301-f2618dd8ee31 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:31.299920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-2aef6d17-f17a-404a-8a0a-7a7f81c00534 req-8aff4c33-f042-488a-b301-f2618dd8ee31 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:31.301073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4735e514-4704-4394-a83d-3ec633a3a808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:31.301759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4735e514-4704-4394-a83d-3ec633a3a808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:31.322673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-2aef6d17-f17a-404a-8a0a-7a7f81c00534 req-8aff4c33-f042-488a-b301-f2618dd8ee31 service nova] Creating event network-changed:d8dbce75-bbb2-4b0b-bc43-c864b59621e9 for instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be on hv-cinder-81322 Feb 21 00:37:31.329979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-2aef6d17-f17a-404a-8a0a-7a7f81c00534 req-8aff4c33-f042-488a-b301-f2618dd8ee31 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047808 Feb 21 00:37:31.334435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 92/163] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:37:31.337585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4735e514-4704-4394-a83d-3ec633a3a808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/ips" status: 200 len: 113 microversion: 2.20 time: 0.057923 Feb 21 00:37:31.338273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 72/164] 10.222.0.72 () {60 vars in 1288 bytes} [Mon Feb 21 00:37:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/ips => generated 113 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 00:37:31.450485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4047db93-e155-4308-9ad0-8d2400b28226 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:31.452216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4047db93-e155-4308-9ad0-8d2400b28226 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:31.461715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4047db93-e155-4308-9ad0-8d2400b28226 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:31.462532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4047db93-e155-4308-9ad0-8d2400b28226 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:31.464535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4047db93-e155-4308-9ad0-8d2400b28226 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:31.465322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4047db93-e155-4308-9ad0-8d2400b28226 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:31.711528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4047db93-e155-4308-9ad0-8d2400b28226 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:31.719381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4047db93-e155-4308-9ad0-8d2400b28226 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.274959 Feb 21 00:37:31.720225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 93/165] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:31 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:32.738295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8bbdbc72-8391-450e-84a7-a88a3a7213a7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:32.739186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8bbdbc72-8391-450e-84a7-a88a3a7213a7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:32.745240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8bbdbc72-8391-450e-84a7-a88a3a7213a7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:32.745677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8bbdbc72-8391-450e-84a7-a88a3a7213a7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:32.746456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8bbdbc72-8391-450e-84a7-a88a3a7213a7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:32.746882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8bbdbc72-8391-450e-84a7-a88a3a7213a7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:32.918108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8bbdbc72-8391-450e-84a7-a88a3a7213a7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:32.926029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8bbdbc72-8391-450e-84a7-a88a3a7213a7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.191340 Feb 21 00:37:32.926603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 73/166] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:32 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:33.942553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0f6c4188-fa0b-4d9c-a751-a63ebfcac9d8 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:33.943243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0f6c4188-fa0b-4d9c-a751-a63ebfcac9d8 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:33.949410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f6c4188-fa0b-4d9c-a751-a63ebfcac9d8 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:33.949940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f6c4188-fa0b-4d9c-a751-a63ebfcac9d8 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:33.950780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f6c4188-fa0b-4d9c-a751-a63ebfcac9d8 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:33.951271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f6c4188-fa0b-4d9c-a751-a63ebfcac9d8 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:34.084816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0f6c4188-fa0b-4d9c-a751-a63ebfcac9d8 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:34.092203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0f6c4188-fa0b-4d9c-a751-a63ebfcac9d8 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.153367 Feb 21 00:37:34.092792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 94/167] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:33 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:35.109595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-24f6c2b3-bccd-47dc-858e-2c23b404ad31 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:35.110702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-24f6c2b3-bccd-47dc-858e-2c23b404ad31 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:35.119035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-24f6c2b3-bccd-47dc-858e-2c23b404ad31 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:35.119479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-24f6c2b3-bccd-47dc-858e-2c23b404ad31 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:35.120237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-24f6c2b3-bccd-47dc-858e-2c23b404ad31 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:35.120685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-24f6c2b3-bccd-47dc-858e-2c23b404ad31 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:35.262179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-24f6c2b3-bccd-47dc-858e-2c23b404ad31 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:35.270210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-24f6c2b3-bccd-47dc-858e-2c23b404ad31 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.165210 Feb 21 00:37:35.270782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 74/168] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:35 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:36.287281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f15a6ffd-d9d3-4b40-9b2a-b6a9d683c08c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:36.288777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f15a6ffd-d9d3-4b40-9b2a-b6a9d683c08c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:36.294668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f15a6ffd-d9d3-4b40-9b2a-b6a9d683c08c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:36.295175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f15a6ffd-d9d3-4b40-9b2a-b6a9d683c08c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:36.296177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f15a6ffd-d9d3-4b40-9b2a-b6a9d683c08c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:36.296773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f15a6ffd-d9d3-4b40-9b2a-b6a9d683c08c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:36.507792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f15a6ffd-d9d3-4b40-9b2a-b6a9d683c08c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:36.513411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f15a6ffd-d9d3-4b40-9b2a-b6a9d683c08c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.229751 Feb 21 00:37:36.514600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 95/169] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:36 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:37.532802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4bdddade-b789-495e-8282-9bc443935197 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:37.533595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4bdddade-b789-495e-8282-9bc443935197 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:37.542207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4bdddade-b789-495e-8282-9bc443935197 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:37.542742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4bdddade-b789-495e-8282-9bc443935197 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:37.543756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4bdddade-b789-495e-8282-9bc443935197 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:37.544306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4bdddade-b789-495e-8282-9bc443935197 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:37.691841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4bdddade-b789-495e-8282-9bc443935197 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:37.703345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4bdddade-b789-495e-8282-9bc443935197 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.176461 Feb 21 00:37:37.703936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 75/170] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:37 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:38.719999 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-729683ed-c76f-46b5-bf29-1503371e45a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:38.720641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-729683ed-c76f-46b5-bf29-1503371e45a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:38.726540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-729683ed-c76f-46b5-bf29-1503371e45a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:38.726981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-729683ed-c76f-46b5-bf29-1503371e45a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:38.727740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-729683ed-c76f-46b5-bf29-1503371e45a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:38.728163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-729683ed-c76f-46b5-bf29-1503371e45a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:38.873330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-729683ed-c76f-46b5-bf29-1503371e45a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:38.884471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-729683ed-c76f-46b5-bf29-1503371e45a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.167851 Feb 21 00:37:38.885263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 96/171] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:38 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:39.900652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ef0ef934-bbb8-4bdf-bdde-50e595bd67d6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:39.901256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ef0ef934-bbb8-4bdf-bdde-50e595bd67d6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:39.908115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef0ef934-bbb8-4bdf-bdde-50e595bd67d6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:39.908596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef0ef934-bbb8-4bdf-bdde-50e595bd67d6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:39.909382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef0ef934-bbb8-4bdf-bdde-50e595bd67d6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:39.909850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef0ef934-bbb8-4bdf-bdde-50e595bd67d6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:40.048101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ef0ef934-bbb8-4bdf-bdde-50e595bd67d6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:40.055691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ef0ef934-bbb8-4bdf-bdde-50e595bd67d6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.158675 Feb 21 00:37:40.056243 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 76/172] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:39 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:41.072965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-297092e9-87fd-4422-9dcc-fc9d1cb24a95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:41.073560 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-297092e9-87fd-4422-9dcc-fc9d1cb24a95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:41.079949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-297092e9-87fd-4422-9dcc-fc9d1cb24a95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:41.080383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-297092e9-87fd-4422-9dcc-fc9d1cb24a95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:41.081199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-297092e9-87fd-4422-9dcc-fc9d1cb24a95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:41.081636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-297092e9-87fd-4422-9dcc-fc9d1cb24a95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:41.219900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-297092e9-87fd-4422-9dcc-fc9d1cb24a95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:41.228498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-297092e9-87fd-4422-9dcc-fc9d1cb24a95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.159380 Feb 21 00:37:41.229977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 97/173] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:41 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:42.245854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2be24d88-cc08-439f-ad53-19c0dcd5e205 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:42.247055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2be24d88-cc08-439f-ad53-19c0dcd5e205 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:42.253704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2be24d88-cc08-439f-ad53-19c0dcd5e205 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:42.254209 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2be24d88-cc08-439f-ad53-19c0dcd5e205 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:42.255034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2be24d88-cc08-439f-ad53-19c0dcd5e205 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:42.255529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2be24d88-cc08-439f-ad53-19c0dcd5e205 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:42.396428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2be24d88-cc08-439f-ad53-19c0dcd5e205 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:42.403815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2be24d88-cc08-439f-ad53-19c0dcd5e205 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.161702 Feb 21 00:37:42.404380 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 77/174] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:42 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:43.424455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d7d2368d-f853-48cf-898f-237360cee3da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:43.425547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d7d2368d-f853-48cf-898f-237360cee3da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:43.435149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7d2368d-f853-48cf-898f-237360cee3da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:43.435882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7d2368d-f853-48cf-898f-237360cee3da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:43.437228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7d2368d-f853-48cf-898f-237360cee3da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:43.437865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7d2368d-f853-48cf-898f-237360cee3da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:43.588047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d7d2368d-f853-48cf-898f-237360cee3da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:43.595876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d7d2368d-f853-48cf-898f-237360cee3da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.177504 Feb 21 00:37:43.596451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 98/175] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:43 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:44.614491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6098b95b-bfe8-4718-b349-ee7708ab4387 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:44.615440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6098b95b-bfe8-4718-b349-ee7708ab4387 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:44.625194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6098b95b-bfe8-4718-b349-ee7708ab4387 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:44.625783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6098b95b-bfe8-4718-b349-ee7708ab4387 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:44.626950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6098b95b-bfe8-4718-b349-ee7708ab4387 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:44.627614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6098b95b-bfe8-4718-b349-ee7708ab4387 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:44.766486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6098b95b-bfe8-4718-b349-ee7708ab4387 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:44.773861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6098b95b-bfe8-4718-b349-ee7708ab4387 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.164790 Feb 21 00:37:44.774400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 78/176] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:44 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:45.794676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a17dd804-4f2b-462d-a171-883e897c6463 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:45.795646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a17dd804-4f2b-462d-a171-883e897c6463 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:45.806051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a17dd804-4f2b-462d-a171-883e897c6463 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:45.806783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a17dd804-4f2b-462d-a171-883e897c6463 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:45.808034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a17dd804-4f2b-462d-a171-883e897c6463 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:45.808814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a17dd804-4f2b-462d-a171-883e897c6463 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:45.946543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a17dd804-4f2b-462d-a171-883e897c6463 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:45.954037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a17dd804-4f2b-462d-a171-883e897c6463 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.165431 Feb 21 00:37:45.954598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 99/177] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:45 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:46.971809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-86b048f0-912d-4f88-8d97-cc76921eff5a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:46.972403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-86b048f0-912d-4f88-8d97-cc76921eff5a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:46.979034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-86b048f0-912d-4f88-8d97-cc76921eff5a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:46.979474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-86b048f0-912d-4f88-8d97-cc76921eff5a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:46.980279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-86b048f0-912d-4f88-8d97-cc76921eff5a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:46.980741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-86b048f0-912d-4f88-8d97-cc76921eff5a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:47.131125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-86b048f0-912d-4f88-8d97-cc76921eff5a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:47.139225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-86b048f0-912d-4f88-8d97-cc76921eff5a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.171982 Feb 21 00:37:47.139809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 79/178] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:46 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:48.158969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-aa1b7fb5-7219-44f3-9385-33a2a825cf45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:48.159523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-aa1b7fb5-7219-44f3-9385-33a2a825cf45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:48.166344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa1b7fb5-7219-44f3-9385-33a2a825cf45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:48.166785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa1b7fb5-7219-44f3-9385-33a2a825cf45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:48.167545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa1b7fb5-7219-44f3-9385-33a2a825cf45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:48.167967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa1b7fb5-7219-44f3-9385-33a2a825cf45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:48.309822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-aa1b7fb5-7219-44f3-9385-33a2a825cf45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:48.317759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-aa1b7fb5-7219-44f3-9385-33a2a825cf45 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.164055 Feb 21 00:37:48.318324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 100/179] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:48 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:49.334826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e40cff7d-498d-4dc3-ac80-33cefc2bd052 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:49.335574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e40cff7d-498d-4dc3-ac80-33cefc2bd052 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:49.342834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e40cff7d-498d-4dc3-ac80-33cefc2bd052 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:49.343307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e40cff7d-498d-4dc3-ac80-33cefc2bd052 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:49.344108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e40cff7d-498d-4dc3-ac80-33cefc2bd052 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:49.344567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e40cff7d-498d-4dc3-ac80-33cefc2bd052 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:49.480949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e40cff7d-498d-4dc3-ac80-33cefc2bd052 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:49.488308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e40cff7d-498d-4dc3-ac80-33cefc2bd052 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.157538 Feb 21 00:37:49.488899 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 80/180] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:49 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:50.509215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-72f9b492-0ddd-44d2-9992-a944bc96f69d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:50.510266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-72f9b492-0ddd-44d2-9992-a944bc96f69d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:50.518568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-72f9b492-0ddd-44d2-9992-a944bc96f69d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:50.519051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-72f9b492-0ddd-44d2-9992-a944bc96f69d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:50.519830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-72f9b492-0ddd-44d2-9992-a944bc96f69d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:50.520258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-72f9b492-0ddd-44d2-9992-a944bc96f69d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:50.650537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-72f9b492-0ddd-44d2-9992-a944bc96f69d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:50.658203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-72f9b492-0ddd-44d2-9992-a944bc96f69d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.155337 Feb 21 00:37:50.658786 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 101/181] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:50 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:50.820039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8be8978c-6bd3-4beb-962e-9779f2a16944 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:50.820569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8be8978c-6bd3-4beb-962e-9779f2a16944 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:50.829771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8be8978c-6bd3-4beb-962e-9779f2a16944 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:50.830204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8be8978c-6bd3-4beb-962e-9779f2a16944 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:50.830971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8be8978c-6bd3-4beb-962e-9779f2a16944 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:50.831392 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8be8978c-6bd3-4beb-962e-9779f2a16944 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:50.862260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8be8978c-6bd3-4beb-962e-9779f2a16944 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:37:50.956459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8be8978c-6bd3-4beb-962e-9779f2a16944 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 204 len: 0 microversion: 2.1 time: 0.142191 Feb 21 00:37:50.957432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 81/182] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:37:50 2022] DELETE /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:37:50.965452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8ed528c4-2b97-4a76-b030-734901700b20 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:50.966202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8ed528c4-2b97-4a76-b030-734901700b20 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:50.972277 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8ed528c4-2b97-4a76-b030-734901700b20 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:50.972762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8ed528c4-2b97-4a76-b030-734901700b20 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:50.973548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8ed528c4-2b97-4a76-b030-734901700b20 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:50.973982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8ed528c4-2b97-4a76-b030-734901700b20 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:51.121583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8ed528c4-2b97-4a76-b030-734901700b20 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:51.129488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8ed528c4-2b97-4a76-b030-734901700b20 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.167716 Feb 21 00:37:51.130101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 102/183] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:50 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:51.676275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-93b607b9-d8a5-4ad0-a375-afe75f0414b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:51.677062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-93b607b9-d8a5-4ad0-a375-afe75f0414b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:51.684037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-93b607b9-d8a5-4ad0-a375-afe75f0414b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:51.684574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-93b607b9-d8a5-4ad0-a375-afe75f0414b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:51.685438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-93b607b9-d8a5-4ad0-a375-afe75f0414b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:51.685922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-93b607b9-d8a5-4ad0-a375-afe75f0414b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:51.828477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-93b607b9-d8a5-4ad0-a375-afe75f0414b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:51.839921 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-93b607b9-d8a5-4ad0-a375-afe75f0414b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.168020 Feb 21 00:37:51.840807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 82/184] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:51 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:52.150694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1427e140-8801-4138-a12a-e4df3bb8cff1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:52.151478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1427e140-8801-4138-a12a-e4df3bb8cff1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:52.161780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1427e140-8801-4138-a12a-e4df3bb8cff1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:52.162508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1427e140-8801-4138-a12a-e4df3bb8cff1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:52.164147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1427e140-8801-4138-a12a-e4df3bb8cff1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:52.164901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1427e140-8801-4138-a12a-e4df3bb8cff1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:52.307045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1427e140-8801-4138-a12a-e4df3bb8cff1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:52.319275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1427e140-8801-4138-a12a-e4df3bb8cff1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.174641 Feb 21 00:37:52.320071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 103/185] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:52 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:52.859476 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1e7e7041-7d01-4b07-af13-52cbcd2ac4e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:52.860085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1e7e7041-7d01-4b07-af13-52cbcd2ac4e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:52.867050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e7e7041-7d01-4b07-af13-52cbcd2ac4e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:52.867492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e7e7041-7d01-4b07-af13-52cbcd2ac4e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:52.868267 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e7e7041-7d01-4b07-af13-52cbcd2ac4e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:52.868730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e7e7041-7d01-4b07-af13-52cbcd2ac4e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:53.011264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1e7e7041-7d01-4b07-af13-52cbcd2ac4e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:53.018743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1e7e7041-7d01-4b07-af13-52cbcd2ac4e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.164892 Feb 21 00:37:53.019310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 83/186] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:52 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:53.336205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-975506ab-ede0-45f2-9843-d24dcb09ebe3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:53.336870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-975506ab-ede0-45f2-9843-d24dcb09ebe3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:53.343300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-975506ab-ede0-45f2-9843-d24dcb09ebe3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:53.343764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-975506ab-ede0-45f2-9843-d24dcb09ebe3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:53.344568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-975506ab-ede0-45f2-9843-d24dcb09ebe3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:53.345024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-975506ab-ede0-45f2-9843-d24dcb09ebe3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:53.490523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-975506ab-ede0-45f2-9843-d24dcb09ebe3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:53.498736 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-975506ab-ede0-45f2-9843-d24dcb09ebe3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.166231 Feb 21 00:37:53.499301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 104/187] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:53 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:54.036600 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-74b69eeb-d0ba-42fd-ba91-e793f48d5246 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:54.037156 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-74b69eeb-d0ba-42fd-ba91-e793f48d5246 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:54.044221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-74b69eeb-d0ba-42fd-ba91-e793f48d5246 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:54.044691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-74b69eeb-d0ba-42fd-ba91-e793f48d5246 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:54.045459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-74b69eeb-d0ba-42fd-ba91-e793f48d5246 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:54.045885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-74b69eeb-d0ba-42fd-ba91-e793f48d5246 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:54.180007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-74b69eeb-d0ba-42fd-ba91-e793f48d5246 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:54.188248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-74b69eeb-d0ba-42fd-ba91-e793f48d5246 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.155355 Feb 21 00:37:54.188852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 84/188] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:54 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:54.516373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b80374f1-1302-4f07-b797-e0bc72621c04 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:54.517108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b80374f1-1302-4f07-b797-e0bc72621c04 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:54.524255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b80374f1-1302-4f07-b797-e0bc72621c04 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:54.524764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b80374f1-1302-4f07-b797-e0bc72621c04 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:54.525631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b80374f1-1302-4f07-b797-e0bc72621c04 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:54.526107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b80374f1-1302-4f07-b797-e0bc72621c04 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:54.665017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b80374f1-1302-4f07-b797-e0bc72621c04 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:54.673295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b80374f1-1302-4f07-b797-e0bc72621c04 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.161131 Feb 21 00:37:54.674052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 105/189] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:54 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:55.206750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-49bd2614-0eb1-48f6-881c-9d2517b33afd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:55.207376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-49bd2614-0eb1-48f6-881c-9d2517b33afd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:55.214079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49bd2614-0eb1-48f6-881c-9d2517b33afd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:55.214522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49bd2614-0eb1-48f6-881c-9d2517b33afd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:55.215286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49bd2614-0eb1-48f6-881c-9d2517b33afd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:55.215711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49bd2614-0eb1-48f6-881c-9d2517b33afd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:55.353350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-49bd2614-0eb1-48f6-881c-9d2517b33afd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:55.361067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-49bd2614-0eb1-48f6-881c-9d2517b33afd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.158573 Feb 21 00:37:55.361632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 85/190] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:55 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:55.691411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5d0306a2-03d9-4621-ac6c-258f1eb3ebf3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:55.692045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5d0306a2-03d9-4621-ac6c-258f1eb3ebf3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:55.698405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5d0306a2-03d9-4621-ac6c-258f1eb3ebf3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:55.698853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5d0306a2-03d9-4621-ac6c-258f1eb3ebf3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:55.699654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5d0306a2-03d9-4621-ac6c-258f1eb3ebf3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:55.700204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5d0306a2-03d9-4621-ac6c-258f1eb3ebf3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:55.836216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5d0306a2-03d9-4621-ac6c-258f1eb3ebf3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:55.848087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5d0306a2-03d9-4621-ac6c-258f1eb3ebf3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.160091 Feb 21 00:37:55.849005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 106/191] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:55 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:56.384221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1ae4b8e2-b936-4be3-974b-e170d8c54543 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:56.385260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1ae4b8e2-b936-4be3-974b-e170d8c54543 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:56.397120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ae4b8e2-b936-4be3-974b-e170d8c54543 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:56.397862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ae4b8e2-b936-4be3-974b-e170d8c54543 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:56.399133 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ae4b8e2-b936-4be3-974b-e170d8c54543 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:56.399848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ae4b8e2-b936-4be3-974b-e170d8c54543 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:56.551247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1ae4b8e2-b936-4be3-974b-e170d8c54543 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:56.561329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1ae4b8e2-b936-4be3-974b-e170d8c54543 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.185333 Feb 21 00:37:56.562114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 86/192] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:56 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:56.869129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-80e9e726-8a4d-4d1e-8e3a-cf1d29b5243e tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:56.870137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-80e9e726-8a4d-4d1e-8e3a-cf1d29b5243e tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:56.880382 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80e9e726-8a4d-4d1e-8e3a-cf1d29b5243e tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:56.881322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80e9e726-8a4d-4d1e-8e3a-cf1d29b5243e tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:56.882613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80e9e726-8a4d-4d1e-8e3a-cf1d29b5243e tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:56.883332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80e9e726-8a4d-4d1e-8e3a-cf1d29b5243e tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:57.033408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-80e9e726-8a4d-4d1e-8e3a-cf1d29b5243e tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:57.035493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-80e9e726-8a4d-4d1e-8e3a-cf1d29b5243e tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.172520 Feb 21 00:37:57.036067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 107/193] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:56 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:57.578838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-67610d60-2465-4d7f-8366-24263c7fd2fa tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:57.579629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-67610d60-2465-4d7f-8366-24263c7fd2fa tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:57.588288 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-67610d60-2465-4d7f-8366-24263c7fd2fa tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:57.588915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-67610d60-2465-4d7f-8366-24263c7fd2fa tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:57.589932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-67610d60-2465-4d7f-8366-24263c7fd2fa tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:57.590499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-67610d60-2465-4d7f-8366-24263c7fd2fa tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:57.736103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-67610d60-2465-4d7f-8366-24263c7fd2fa tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:57.748253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-67610d60-2465-4d7f-8366-24263c7fd2fa tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.173231 Feb 21 00:37:57.749277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 87/194] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:57 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:58.052781 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c7c54707-abd0-4c6a-bcaa-ad2b4630683a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:58.053407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c7c54707-abd0-4c6a-bcaa-ad2b4630683a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:58.059967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7c54707-abd0-4c6a-bcaa-ad2b4630683a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:58.060051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7c54707-abd0-4c6a-bcaa-ad2b4630683a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:58.060879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7c54707-abd0-4c6a-bcaa-ad2b4630683a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:58.061310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7c54707-abd0-4c6a-bcaa-ad2b4630683a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:58.206901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c7c54707-abd0-4c6a-bcaa-ad2b4630683a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:58.216491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c7c54707-abd0-4c6a-bcaa-ad2b4630683a tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.167011 Feb 21 00:37:58.217143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 108/195] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:58 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:58.766563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b8e09955-9861-4dbd-a789-c50a3b2fa6af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:58.767228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b8e09955-9861-4dbd-a789-c50a3b2fa6af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:58.774382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8e09955-9861-4dbd-a789-c50a3b2fa6af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:58.774870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8e09955-9861-4dbd-a789-c50a3b2fa6af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:58.775687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8e09955-9861-4dbd-a789-c50a3b2fa6af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:58.776146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8e09955-9861-4dbd-a789-c50a3b2fa6af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:58.916007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b8e09955-9861-4dbd-a789-c50a3b2fa6af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:58.923717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b8e09955-9861-4dbd-a789-c50a3b2fa6af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.161292 Feb 21 00:37:58.924283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 88/196] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:58 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:59.238659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c6dc32a8-a100-4266-b067-8b8abb8cb7d1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:59.239719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c6dc32a8-a100-4266-b067-8b8abb8cb7d1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:59.250434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c6dc32a8-a100-4266-b067-8b8abb8cb7d1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:59.251317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c6dc32a8-a100-4266-b067-8b8abb8cb7d1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:59.252722 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c6dc32a8-a100-4266-b067-8b8abb8cb7d1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:59.253157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c6dc32a8-a100-4266-b067-8b8abb8cb7d1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:59.386060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c6dc32a8-a100-4266-b067-8b8abb8cb7d1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:37:59.394364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c6dc32a8-a100-4266-b067-8b8abb8cb7d1 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.162081 Feb 21 00:37:59.394930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 109/197] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:59 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:37:59.940512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cdc3cf57-06a1-4ae1-98ec-c79bf637baf2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:37:59.941121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cdc3cf57-06a1-4ae1-98ec-c79bf637baf2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:37:59.948043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdc3cf57-06a1-4ae1-98ec-c79bf637baf2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:59.948515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdc3cf57-06a1-4ae1-98ec-c79bf637baf2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:37:59.949288 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdc3cf57-06a1-4ae1-98ec-c79bf637baf2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:37:59.949721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdc3cf57-06a1-4ae1-98ec-c79bf637baf2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:00.092361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cdc3cf57-06a1-4ae1-98ec-c79bf637baf2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:00.100230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cdc3cf57-06a1-4ae1-98ec-c79bf637baf2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.163543 Feb 21 00:38:00.100902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 89/198] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:37:59 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:00.415249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2b11b261-af3f-4c3d-8dad-f7affaa53073 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:00.416081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2b11b261-af3f-4c3d-8dad-f7affaa53073 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:00.425605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b11b261-af3f-4c3d-8dad-f7affaa53073 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:00.426044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b11b261-af3f-4c3d-8dad-f7affaa53073 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:00.426814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b11b261-af3f-4c3d-8dad-f7affaa53073 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:00.427244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b11b261-af3f-4c3d-8dad-f7affaa53073 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:00.574701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2b11b261-af3f-4c3d-8dad-f7affaa53073 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:00.583194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2b11b261-af3f-4c3d-8dad-f7affaa53073 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.174622 Feb 21 00:38:00.583760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 110/199] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:00 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:01.117119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bb6ce0c5-2cca-4a7f-a0cf-98194581f92a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:01.117716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bb6ce0c5-2cca-4a7f-a0cf-98194581f92a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:01.124345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb6ce0c5-2cca-4a7f-a0cf-98194581f92a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:01.124819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb6ce0c5-2cca-4a7f-a0cf-98194581f92a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:01.125585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb6ce0c5-2cca-4a7f-a0cf-98194581f92a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:01.126011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb6ce0c5-2cca-4a7f-a0cf-98194581f92a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:01.263210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bb6ce0c5-2cca-4a7f-a0cf-98194581f92a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:01.271112 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bb6ce0c5-2cca-4a7f-a0cf-98194581f92a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.157859 Feb 21 00:38:01.271689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 90/200] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:01 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:01.603735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fc2d1fb0-2574-48a0-ad19-ee8fb688977d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:01.604791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fc2d1fb0-2574-48a0-ad19-ee8fb688977d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:01.615104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc2d1fb0-2574-48a0-ad19-ee8fb688977d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:01.615856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc2d1fb0-2574-48a0-ad19-ee8fb688977d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:01.617208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc2d1fb0-2574-48a0-ad19-ee8fb688977d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:01.617924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc2d1fb0-2574-48a0-ad19-ee8fb688977d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:01.754553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fc2d1fb0-2574-48a0-ad19-ee8fb688977d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:01.762566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fc2d1fb0-2574-48a0-ad19-ee8fb688977d tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.164995 Feb 21 00:38:01.763150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 111/201] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:01 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:02.287011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c764879f-8786-4c46-8173-03932e8477da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:02.287900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c764879f-8786-4c46-8173-03932e8477da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:02.295572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c764879f-8786-4c46-8173-03932e8477da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:02.296020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c764879f-8786-4c46-8173-03932e8477da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:02.296826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c764879f-8786-4c46-8173-03932e8477da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:02.297253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c764879f-8786-4c46-8173-03932e8477da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:02.437443 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c764879f-8786-4c46-8173-03932e8477da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:02.445202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c764879f-8786-4c46-8173-03932e8477da tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.161890 Feb 21 00:38:02.445779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 91/202] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:02 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:02.785277 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6aee7b46-9438-4c2b-b4f0-23ce9cecd3c3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:02.786172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6aee7b46-9438-4c2b-b4f0-23ce9cecd3c3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:02.796909 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6aee7b46-9438-4c2b-b4f0-23ce9cecd3c3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:02.797643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6aee7b46-9438-4c2b-b4f0-23ce9cecd3c3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:02.798959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6aee7b46-9438-4c2b-b4f0-23ce9cecd3c3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:02.799726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6aee7b46-9438-4c2b-b4f0-23ce9cecd3c3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:02.937120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6aee7b46-9438-4c2b-b4f0-23ce9cecd3c3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:02.945424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6aee7b46-9438-4c2b-b4f0-23ce9cecd3c3 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.166349 Feb 21 00:38:02.946008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 112/203] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:02 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:03.465709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7ed8d92e-a5fe-42fb-bbdf-0f00c38d2e7d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:03.466839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7ed8d92e-a5fe-42fb-bbdf-0f00c38d2e7d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:03.477837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ed8d92e-a5fe-42fb-bbdf-0f00c38d2e7d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:03.478574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ed8d92e-a5fe-42fb-bbdf-0f00c38d2e7d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:03.479830 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ed8d92e-a5fe-42fb-bbdf-0f00c38d2e7d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:03.480572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ed8d92e-a5fe-42fb-bbdf-0f00c38d2e7d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:03.617737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7ed8d92e-a5fe-42fb-bbdf-0f00c38d2e7d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:03.625773 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7ed8d92e-a5fe-42fb-bbdf-0f00c38d2e7d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.166152 Feb 21 00:38:03.626323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 92/204] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:03 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:03.968473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f2f20566-1ec3-47d3-abc2-6a2ae4b637b9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:03.969315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f2f20566-1ec3-47d3-abc2-6a2ae4b637b9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:03.979620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2f20566-1ec3-47d3-abc2-6a2ae4b637b9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:03.980354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2f20566-1ec3-47d3-abc2-6a2ae4b637b9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:03.981688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2f20566-1ec3-47d3-abc2-6a2ae4b637b9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:03.982399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2f20566-1ec3-47d3-abc2-6a2ae4b637b9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:04.117661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f2f20566-1ec3-47d3-abc2-6a2ae4b637b9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:04.125805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f2f20566-1ec3-47d3-abc2-6a2ae4b637b9 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.163584 Feb 21 00:38:04.126356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 113/205] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:03 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:04.644029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-caba2c7e-9f60-4b90-ac14-31566a309c2d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:04.644691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-caba2c7e-9f60-4b90-ac14-31566a309c2d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:04.651987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-caba2c7e-9f60-4b90-ac14-31566a309c2d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:04.652507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-caba2c7e-9f60-4b90-ac14-31566a309c2d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:04.653374 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-caba2c7e-9f60-4b90-ac14-31566a309c2d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:04.653841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-caba2c7e-9f60-4b90-ac14-31566a309c2d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:04.798431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-caba2c7e-9f60-4b90-ac14-31566a309c2d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:04.806324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-caba2c7e-9f60-4b90-ac14-31566a309c2d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.166455 Feb 21 00:38:04.806894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 93/206] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:04 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:05.142885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d70e5a78-4643-4727-8104-318c1511a2a8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:05.143595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d70e5a78-4643-4727-8104-318c1511a2a8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:05.150324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d70e5a78-4643-4727-8104-318c1511a2a8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:05.150777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d70e5a78-4643-4727-8104-318c1511a2a8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:05.151564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d70e5a78-4643-4727-8104-318c1511a2a8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:05.152021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d70e5a78-4643-4727-8104-318c1511a2a8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:05.283066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d70e5a78-4643-4727-8104-318c1511a2a8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:05.292010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d70e5a78-4643-4727-8104-318c1511a2a8 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1552 microversion: 2.1 time: 0.152821 Feb 21 00:38:05.292624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 114/207] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:05 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:05.832347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f4b7c2e4-ba64-4031-adad-e7971b069e7f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:05.833003 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f4b7c2e4-ba64-4031-adad-e7971b069e7f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:05.839439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4b7c2e4-ba64-4031-adad-e7971b069e7f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:05.839901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4b7c2e4-ba64-4031-adad-e7971b069e7f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:05.840715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4b7c2e4-ba64-4031-adad-e7971b069e7f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:05.841149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4b7c2e4-ba64-4031-adad-e7971b069e7f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:05.958710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-78d572ca-b9d2-41aa-aa6c-e6599db8bc20 req-6dadebaa-ca62-4a3b-a3e3-5bbbba12c7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47fdd17-aabc-46ec-b8eb-1611ca351b02", "name": "network-vif-deleted", "tag": "e67eb7bd-3133-41a3-bc80-324738730e42"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:38:05.960284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:38:05.960284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:38:05.971268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-78d572ca-b9d2-41aa-aa6c-e6599db8bc20 req-6dadebaa-ca62-4a3b-a3e3-5bbbba12c7b8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:05.971903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-78d572ca-b9d2-41aa-aa6c-e6599db8bc20 req-6dadebaa-ca62-4a3b-a3e3-5bbbba12c7b8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:05.983718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-78d572ca-b9d2-41aa-aa6c-e6599db8bc20 req-6dadebaa-ca62-4a3b-a3e3-5bbbba12c7b8 service nova] Creating event network-vif-deleted:e67eb7bd-3133-41a3-bc80-324738730e42 for instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 on hv-cinder-81322 Feb 21 00:38:05.989299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-78d572ca-b9d2-41aa-aa6c-e6599db8bc20 req-6dadebaa-ca62-4a3b-a3e3-5bbbba12c7b8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034245 Feb 21 00:38:05.990746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 115/208] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:38:06.036337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f4b7c2e4-ba64-4031-adad-e7971b069e7f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:06.044609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f4b7c2e4-ba64-4031-adad-e7971b069e7f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.219475 Feb 21 00:38:06.048438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 94/209] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:05 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:06.310485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-679d75dc-9b8a-4e67-b8ed-f9bcfbbe6f91 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:06.311354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-679d75dc-9b8a-4e67-b8ed-f9bcfbbe6f91 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:06.317566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-679d75dc-9b8a-4e67-b8ed-f9bcfbbe6f91 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:06.318376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-679d75dc-9b8a-4e67-b8ed-f9bcfbbe6f91 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:06.319352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-679d75dc-9b8a-4e67-b8ed-f9bcfbbe6f91 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:06.320026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-679d75dc-9b8a-4e67-b8ed-f9bcfbbe6f91 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:06.382475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-679d75dc-9b8a-4e67-b8ed-f9bcfbbe6f91 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:06.390358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-679d75dc-9b8a-4e67-b8ed-f9bcfbbe6f91 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1345 microversion: 2.1 time: 0.083955 Feb 21 00:38:06.390922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 116/210] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:06 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:07.061079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ddf7d6ed-fc0d-4988-9055-07fb06a0a3ef tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:07.061742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ddf7d6ed-fc0d-4988-9055-07fb06a0a3ef tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:07.068106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ddf7d6ed-fc0d-4988-9055-07fb06a0a3ef tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:07.068588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ddf7d6ed-fc0d-4988-9055-07fb06a0a3ef tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:07.069359 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ddf7d6ed-fc0d-4988-9055-07fb06a0a3ef tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:07.069792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ddf7d6ed-fc0d-4988-9055-07fb06a0a3ef tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:07.212256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ddf7d6ed-fc0d-4988-9055-07fb06a0a3ef tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:07.220082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ddf7d6ed-fc0d-4988-9055-07fb06a0a3ef tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1521 microversion: 2.1 time: 0.162640 Feb 21 00:38:07.220757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 95/211] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:07 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:07.407212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:07.408558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:07.415983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:07.416607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:07.417817 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:07.418638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:07.455259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:07.455815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:07.456174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lazy-loading 'fault' on Instance uuid e47fdd17-aabc-46ec-b8eb-1611ca351b02 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:38:07.501953 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7754c5b970334acb9b0e24a41a33bfea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8b3a6e4540426fae8d800fbd140571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:07.513648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-17c37dfb-4499-47f2-90ea-eb5b7f195dc5 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 200 len: 1350 microversion: 2.1 time: 0.107093 Feb 21 00:38:07.513648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 117/212] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:07 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:08.236735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a4aed72f-d741-45c4-8943-6039b59dbba6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:08.237368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a4aed72f-d741-45c4-8943-6039b59dbba6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:08.243996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4aed72f-d741-45c4-8943-6039b59dbba6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:08.244426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4aed72f-d741-45c4-8943-6039b59dbba6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:08.245224 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4aed72f-d741-45c4-8943-6039b59dbba6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:08.245697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4aed72f-d741-45c4-8943-6039b59dbba6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:08.379627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a4aed72f-d741-45c4-8943-6039b59dbba6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:08.390800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a4aed72f-d741-45c4-8943-6039b59dbba6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1501 microversion: 2.1 time: 0.157643 Feb 21 00:38:08.402420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 96/213] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:08 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:08.408070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-533e6af5-7d90-4d6e-b6c1-ec6b646e8a12 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:08.409193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-533e6af5-7d90-4d6e-b6c1-ec6b646e8a12 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:08.416032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-533e6af5-7d90-4d6e-b6c1-ec6b646e8a12 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:08.416533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-533e6af5-7d90-4d6e-b6c1-ec6b646e8a12 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:08.417399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-533e6af5-7d90-4d6e-b6c1-ec6b646e8a12 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:08.417829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-533e6af5-7d90-4d6e-b6c1-ec6b646e8a12 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:08.528089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:08.528542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:08.539512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:08.540040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:08.540934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:08.541429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:08.556320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] HTTP exception thrown: Instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 could not be found. Feb 21 00:38:08.556985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Returning 404 to user: Instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:38:08.557811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-498a9485-4663-472f-b1f5-a9cfedec57e6 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 404 len: 111 microversion: 2.1 time: 0.034101 Feb 21 00:38:08.558823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 97/214] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:08 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 00:38:08.564004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-533e6af5-7d90-4d6e-b6c1-ec6b646e8a12 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:08.571988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-533e6af5-7d90-4d6e-b6c1-ec6b646e8a12 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1515 microversion: 2.1 time: 0.168076 Feb 21 00:38:08.573135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 118/215] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:08 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:08.708280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:08.709340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:08.715789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:08.716172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:08.717107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:08.717525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:08.731094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] HTTP exception thrown: Instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 could not be found. Feb 21 00:38:08.732321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Returning 404 to user: Instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:38:08.733537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-693dc7de-d476-45df-b7c3-e537c63f2597 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029539 Feb 21 00:38:08.734298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 98/216] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:38:08 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:38:10.027605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4e813ff7-ce2d-437d-86bf-e69c8e3419b9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:38:10.028594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4e813ff7-ce2d-437d-86bf-e69c8e3419b9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:10.034930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4e813ff7-ce2d-437d-86bf-e69c8e3419b9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:10.035407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4e813ff7-ce2d-437d-86bf-e69c8e3419b9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:10.036198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4e813ff7-ce2d-437d-86bf-e69c8e3419b9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:10.036669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4e813ff7-ce2d-437d-86bf-e69c8e3419b9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:10.059907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-4e813ff7-ce2d-437d-86bf-e69c8e3419b9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lazy-loading 'flavor' on Instance uuid 2bedd6d6-814a-48db-a1ca-b35b01e44759 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:38:10.183322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4e813ff7-ce2d-437d-86bf-e69c8e3419b9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/action" status: 200 len: 32 microversion: 2.1 time: 0.159502 Feb 21 00:38:10.184137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 119/217] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:38:10 2022] POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 00:38:10.193013 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0723b56e-caeb-4704-bec7-823b4cf1efa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:10.193705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0723b56e-caeb-4704-bec7-823b4cf1efa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:10.200076 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0723b56e-caeb-4704-bec7-823b4cf1efa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:10.200557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0723b56e-caeb-4704-bec7-823b4cf1efa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:10.201594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0723b56e-caeb-4704-bec7-823b4cf1efa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:10.202132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0723b56e-caeb-4704-bec7-823b4cf1efa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:10.411669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0723b56e-caeb-4704-bec7-823b4cf1efa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:10.419726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0723b56e-caeb-4704-bec7-823b4cf1efa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.230384 Feb 21 00:38:10.420305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 99/218] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:10 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:11.207859 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:11.209246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:11.215403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:11.216117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:11.217259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:11.217831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:11.231941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] HTTP exception thrown: Instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 could not be found. Feb 21 00:38:11.232619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Returning 404 to user: Instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:38:11.233377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-021366eb-f941-4ae8-bfe9-769d88ac8745 tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 404 len: 111 microversion: 2.1 time: 0.029728 Feb 21 00:38:11.234064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 120/219] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:38:11 2022] DELETE /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:38:11.242045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:11.242652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] [instance: e47fdd17-aabc-46ec-b8eb-1611ca351b02] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:11.249887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:11.250682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:11.251472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:11.251904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:11.270521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] HTTP exception thrown: Instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 could not be found. Feb 21 00:38:11.271113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] Returning 404 to user: Instance e47fdd17-aabc-46ec-b8eb-1611ca351b02 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:38:11.271944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-554dadcb-028f-414f-98fb-b3247dc899ba tempest-DeleteServersTestJSON-319281525 tempest-DeleteServersTestJSON-319281525-project] 10.222.0.72 "GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02" status: 404 len: 111 microversion: 2.1 time: 0.033623 Feb 21 00:38:11.275953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 100/220] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:11 2022] GET /compute/v2.1/servers/e47fdd17-aabc-46ec-b8eb-1611ca351b02 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:38:11.438782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9337d76b-2b15-4b63-805e-5151cc6faedd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:11.439554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9337d76b-2b15-4b63-805e-5151cc6faedd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:11.445666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9337d76b-2b15-4b63-805e-5151cc6faedd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:11.446408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9337d76b-2b15-4b63-805e-5151cc6faedd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:11.447300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9337d76b-2b15-4b63-805e-5151cc6faedd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:11.447797 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9337d76b-2b15-4b63-805e-5151cc6faedd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:11.600827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9337d76b-2b15-4b63-805e-5151cc6faedd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:11.608742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9337d76b-2b15-4b63-805e-5151cc6faedd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.173895 Feb 21 00:38:11.609322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 121/221] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:11 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:12.624784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1b5bbe0e-594f-4022-8afd-90d42d04464e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:12.625385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1b5bbe0e-594f-4022-8afd-90d42d04464e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:12.632762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b5bbe0e-594f-4022-8afd-90d42d04464e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:12.633427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b5bbe0e-594f-4022-8afd-90d42d04464e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:12.634370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b5bbe0e-594f-4022-8afd-90d42d04464e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:12.634960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b5bbe0e-594f-4022-8afd-90d42d04464e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:13.005255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1b5bbe0e-594f-4022-8afd-90d42d04464e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:13.014207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1b5bbe0e-594f-4022-8afd-90d42d04464e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.392840 Feb 21 00:38:13.024348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 101/222] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:12 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:14.034836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fd745226-04a7-45cc-9660-c57b2ca7b666 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:14.035453 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fd745226-04a7-45cc-9660-c57b2ca7b666 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:14.041914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd745226-04a7-45cc-9660-c57b2ca7b666 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:14.042296 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd745226-04a7-45cc-9660-c57b2ca7b666 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:14.043087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd745226-04a7-45cc-9660-c57b2ca7b666 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:14.043520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd745226-04a7-45cc-9660-c57b2ca7b666 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:14.186721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fd745226-04a7-45cc-9660-c57b2ca7b666 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:14.194216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fd745226-04a7-45cc-9660-c57b2ca7b666 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.167029 Feb 21 00:38:14.194789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 122/223] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:14 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:15.211011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5425703f-e302-47d6-a5bb-2fd7707079e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:15.211700 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5425703f-e302-47d6-a5bb-2fd7707079e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:15.218082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5425703f-e302-47d6-a5bb-2fd7707079e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:15.218603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5425703f-e302-47d6-a5bb-2fd7707079e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:15.219650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5425703f-e302-47d6-a5bb-2fd7707079e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:15.220231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5425703f-e302-47d6-a5bb-2fd7707079e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:15.363822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5425703f-e302-47d6-a5bb-2fd7707079e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:15.375464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5425703f-e302-47d6-a5bb-2fd7707079e9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.167912 Feb 21 00:38:15.376166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 102/224] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:15 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:16.401338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-de9ab8e2-f5d7-46c1-8618-60b320472bd1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:16.402315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-de9ab8e2-f5d7-46c1-8618-60b320472bd1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:16.411308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de9ab8e2-f5d7-46c1-8618-60b320472bd1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:16.411748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de9ab8e2-f5d7-46c1-8618-60b320472bd1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:16.412875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de9ab8e2-f5d7-46c1-8618-60b320472bd1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:16.413295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de9ab8e2-f5d7-46c1-8618-60b320472bd1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:16.560764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-de9ab8e2-f5d7-46c1-8618-60b320472bd1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:16.568805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-de9ab8e2-f5d7-46c1-8618-60b320472bd1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.173599 Feb 21 00:38:16.569368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 123/225] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:16 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:17.588563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6f330dcd-d6b7-49cd-bc22-2306956de66b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:17.589574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6f330dcd-d6b7-49cd-bc22-2306956de66b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:17.600361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f330dcd-d6b7-49cd-bc22-2306956de66b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:17.601080 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f330dcd-d6b7-49cd-bc22-2306956de66b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:17.602358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f330dcd-d6b7-49cd-bc22-2306956de66b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:17.603066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f330dcd-d6b7-49cd-bc22-2306956de66b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:17.739910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6f330dcd-d6b7-49cd-bc22-2306956de66b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:17.747279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6f330dcd-d6b7-49cd-bc22-2306956de66b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.164871 Feb 21 00:38:17.747825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 103/226] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:17 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:18.769186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-546ad030-de0f-4668-901f-1628be1b4d9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:18.769816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-546ad030-de0f-4668-901f-1628be1b4d9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:18.776580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-546ad030-de0f-4668-901f-1628be1b4d9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:18.777019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-546ad030-de0f-4668-901f-1628be1b4d9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:18.777779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-546ad030-de0f-4668-901f-1628be1b4d9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:18.778303 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-546ad030-de0f-4668-901f-1628be1b4d9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:18.909774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ee6cd4c-a573-4dcb-83b3-f04bbf9daa26 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56d572790>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:18.914314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-546ad030-de0f-4668-901f-1628be1b4d9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:18.926059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-546ad030-de0f-4668-901f-1628be1b4d9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.160738 Feb 21 00:38:18.926677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 124/227] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:18 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:18.957863 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ee6cd4c-a573-4dcb-83b3-f04bbf9daa26 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/ebb283df-63ca-4cb7-9dff-6059b2a1b8ff" status: 200 len: 351 microversion: 2.1 time: 0.051758 Feb 21 00:38:18.958463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 104/228] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:38:18 2022] GET /compute/v2.1/os-volumes/ebb283df-63ca-4cb7-9dff-6059b2a1b8ff => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:38:19.947279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8c9758d2-26a4-4414-aaed-382dd119b251 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:19.948305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8c9758d2-26a4-4414-aaed-382dd119b251 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:19.957592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c9758d2-26a4-4414-aaed-382dd119b251 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:19.958036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c9758d2-26a4-4414-aaed-382dd119b251 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:19.958814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c9758d2-26a4-4414-aaed-382dd119b251 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:19.959242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c9758d2-26a4-4414-aaed-382dd119b251 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:20.102783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8c9758d2-26a4-4414-aaed-382dd119b251 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:20.110889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8c9758d2-26a4-4414-aaed-382dd119b251 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.170228 Feb 21 00:38:20.111429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 125/229] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:19 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:21.129083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e70ec7d1-9df1-421a-a6a2-66d6a533c3fd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:21.129792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e70ec7d1-9df1-421a-a6a2-66d6a533c3fd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:21.139678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e70ec7d1-9df1-421a-a6a2-66d6a533c3fd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:21.140299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e70ec7d1-9df1-421a-a6a2-66d6a533c3fd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:21.141529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e70ec7d1-9df1-421a-a6a2-66d6a533c3fd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:21.142163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e70ec7d1-9df1-421a-a6a2-66d6a533c3fd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:21.299214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e70ec7d1-9df1-421a-a6a2-66d6a533c3fd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:21.306557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e70ec7d1-9df1-421a-a6a2-66d6a533c3fd tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.182499 Feb 21 00:38:21.307183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 105/230] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:21 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:22.323057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7d1f51fd-c07e-4d6a-b6c1-36c9365d2aea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:22.324224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7d1f51fd-c07e-4d6a-b6c1-36c9365d2aea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:22.330272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d1f51fd-c07e-4d6a-b6c1-36c9365d2aea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:22.330734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d1f51fd-c07e-4d6a-b6c1-36c9365d2aea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:22.331511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d1f51fd-c07e-4d6a-b6c1-36c9365d2aea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:22.331942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d1f51fd-c07e-4d6a-b6c1-36c9365d2aea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:22.467849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7d1f51fd-c07e-4d6a-b6c1-36c9365d2aea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:22.476701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7d1f51fd-c07e-4d6a-b6c1-36c9365d2aea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.157220 Feb 21 00:38:22.477276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 126/231] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:22 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:23.496626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-57eca5e2-5fce-4c8e-87fd-f2a043b5e692 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:23.497657 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-57eca5e2-5fce-4c8e-87fd-f2a043b5e692 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:23.508460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57eca5e2-5fce-4c8e-87fd-f2a043b5e692 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:23.509222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57eca5e2-5fce-4c8e-87fd-f2a043b5e692 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:23.510501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57eca5e2-5fce-4c8e-87fd-f2a043b5e692 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:23.511213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57eca5e2-5fce-4c8e-87fd-f2a043b5e692 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:23.645063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-57eca5e2-5fce-4c8e-87fd-f2a043b5e692 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:23.652414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-57eca5e2-5fce-4c8e-87fd-f2a043b5e692 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.161895 Feb 21 00:38:23.652962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 106/232] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:23 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:24.672640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-525d7e37-7e2d-44c7-a7b9-8ca2ea848ec2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:24.673529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-525d7e37-7e2d-44c7-a7b9-8ca2ea848ec2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:24.683708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-525d7e37-7e2d-44c7-a7b9-8ca2ea848ec2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:24.684469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-525d7e37-7e2d-44c7-a7b9-8ca2ea848ec2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:24.685796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-525d7e37-7e2d-44c7-a7b9-8ca2ea848ec2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:24.686511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-525d7e37-7e2d-44c7-a7b9-8ca2ea848ec2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:24.820451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-525d7e37-7e2d-44c7-a7b9-8ca2ea848ec2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:24.827996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-525d7e37-7e2d-44c7-a7b9-8ca2ea848ec2 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.161669 Feb 21 00:38:24.828589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 127/233] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:24 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:25.844674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c0ac02b4-0ee3-425c-bd01-6cfb4f650be0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:25.845272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c0ac02b4-0ee3-425c-bd01-6cfb4f650be0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:25.851675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c0ac02b4-0ee3-425c-bd01-6cfb4f650be0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:25.852117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c0ac02b4-0ee3-425c-bd01-6cfb4f650be0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:25.852909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c0ac02b4-0ee3-425c-bd01-6cfb4f650be0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:25.853335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c0ac02b4-0ee3-425c-bd01-6cfb4f650be0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:25.989143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c0ac02b4-0ee3-425c-bd01-6cfb4f650be0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:25.996524 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c0ac02b4-0ee3-425c-bd01-6cfb4f650be0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.155560 Feb 21 00:38:25.997094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 107/234] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:25 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:26.572039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-be26af86-4cd8-4cd1-b334-e2f54964cc10 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56cddd550>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:26.617829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-be26af86-4cd8-4cd1-b334-e2f54964cc10 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/dc975f11-8ee2-4cdd-8934-d3fa418a2d8b" status: 200 len: 351 microversion: 2.1 time: 0.049559 Feb 21 00:38:26.618400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 128/235] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:38:26 2022] GET /compute/v2.1/os-volumes/dc975f11-8ee2-4cdd-8934-d3fa418a2d8b => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:38:27.013404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2d60b576-c43a-4bdc-b12a-49c932eb69eb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:27.014198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2d60b576-c43a-4bdc-b12a-49c932eb69eb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:27.020616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2d60b576-c43a-4bdc-b12a-49c932eb69eb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:27.021228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2d60b576-c43a-4bdc-b12a-49c932eb69eb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:27.022106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2d60b576-c43a-4bdc-b12a-49c932eb69eb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:27.022665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2d60b576-c43a-4bdc-b12a-49c932eb69eb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:27.157894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2d60b576-c43a-4bdc-b12a-49c932eb69eb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:27.165734 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2d60b576-c43a-4bdc-b12a-49c932eb69eb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.156027 Feb 21 00:38:27.166303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 108/236] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:27 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:27.943229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b10c145f-f000-463f-9b49-35db366c4999 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56d6d0d30>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:27.990832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b10c145f-f000-463f-9b49-35db366c4999 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/8940897e-49e6-480b-99ae-e3833318b93a" status: 200 len: 351 microversion: 2.1 time: 0.051187 Feb 21 00:38:27.991436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 129/237] 10.222.0.72 () {58 vars in 1244 bytes} [Mon Feb 21 00:38:27 2022] GET /compute/v2.1/os-volumes/8940897e-49e6-480b-99ae-e3833318b93a => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:38:28.002474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-48510db0-d87d-40f0-9e87-741f4a665375 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56d5d7a60>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.086569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-48510db0-d87d-40f0-9e87-741f4a665375 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087410 Feb 21 00:38:28.087575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 109/238] 10.222.0.72 () {58 vars in 1133 bytes} [Mon Feb 21 00:38:27 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:28.100555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-46e965b7-f7ac-49f1-833f-03f0aba843b0 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56d6b78b0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.187987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-55fc6965-ccb1-4045-9b92-57e6891d69a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.188761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-55fc6965-ccb1-4045-9b92-57e6891d69a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:28.190735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-46e965b7-f7ac-49f1-833f-03f0aba843b0 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093852 Feb 21 00:38:28.192046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 130/239] 10.222.0.72 () {58 vars in 1148 bytes} [Mon Feb 21 00:38:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:38:28.207040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-49b78351-45f0-4f3f-aa39-750cb212c6d7 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56d695310>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.226078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55fc6965-ccb1-4045-9b92-57e6891d69a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:28.226664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55fc6965-ccb1-4045-9b92-57e6891d69a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:28.228914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55fc6965-ccb1-4045-9b92-57e6891d69a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:28.229956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55fc6965-ccb1-4045-9b92-57e6891d69a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:28.292132 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-49b78351-45f0-4f3f-aa39-750cb212c6d7 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.092169 Feb 21 00:38:28.293108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 131/240] 10.222.0.72 () {58 vars in 1133 bytes} [Mon Feb 21 00:38:28 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:28.309574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-edd8a403-c2e2-4d47-a973-0c7ee644ef29 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56cdddd30>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.369526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-55fc6965-ccb1-4045-9b92-57e6891d69a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:28.377251 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-55fc6965-ccb1-4045-9b92-57e6891d69a1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.198290 Feb 21 00:38:28.383126 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 110/241] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:28 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:28.389523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-edd8a403-c2e2-4d47-a973-0c7ee644ef29 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083841 Feb 21 00:38:28.390102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 132/242] 10.222.0.72 () {58 vars in 1166 bytes} [Mon Feb 21 00:38:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:38:28.403501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ed128e70-866e-416a-b5e2-d9448cef763e tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56d572d30>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.485885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ed128e70-866e-416a-b5e2-d9448cef763e tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087673 Feb 21 00:38:28.486478 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 111/243] 10.222.0.72 () {58 vars in 1169 bytes} [Mon Feb 21 00:38:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:38:28.498302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4ce74646-af8e-4ba0-8629-88bcef68bd37 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56df28790>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.579441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4ce74646-af8e-4ba0-8629-88bcef68bd37 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084661 Feb 21 00:38:28.580010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 133/244] 10.222.0.72 () {58 vars in 1154 bytes} [Mon Feb 21 00:38:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:28.590972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-484a3d6f-0aa7-4a22-8a69-951e53c7b6d4 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56d5d7940>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.670313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-484a3d6f-0aa7-4a22-8a69-951e53c7b6d4 tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082878 Feb 21 00:38:28.670864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 112/245] 10.222.0.72 () {58 vars in 1187 bytes} [Mon Feb 21 00:38:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:38:28.682317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5f57490f-17fd-43cb-9b97-f3e31fa981de tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] Calling method '.version_select at 0x7fe56d6b7550>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:28.761028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5f57490f-17fd-43cb-9b97-f3e31fa981de tempest-VolumesTestJSON-993916176 tempest-VolumesTestJSON-993916176-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.081850 Feb 21 00:38:28.761878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 134/246] 10.222.0.72 () {58 vars in 1154 bytes} [Mon Feb 21 00:38:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:29.394348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-35934649-cd14-44b7-a4b4-75468629f641 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:29.396013 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-35934649-cd14-44b7-a4b4-75468629f641 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:29.407992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35934649-cd14-44b7-a4b4-75468629f641 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:29.409538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35934649-cd14-44b7-a4b4-75468629f641 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:29.411572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35934649-cd14-44b7-a4b4-75468629f641 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:29.413955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35934649-cd14-44b7-a4b4-75468629f641 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:29.619239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-35934649-cd14-44b7-a4b4-75468629f641 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:29.630422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-35934649-cd14-44b7-a4b4-75468629f641 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.240386 Feb 21 00:38:29.632302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 113/247] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:29 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:30.648714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-296b93c5-c981-45ec-8e88-e029b3efbf16 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:30.649928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-296b93c5-c981-45ec-8e88-e029b3efbf16 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:30.659611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-296b93c5-c981-45ec-8e88-e029b3efbf16 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:30.660573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-296b93c5-c981-45ec-8e88-e029b3efbf16 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:30.663034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-296b93c5-c981-45ec-8e88-e029b3efbf16 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:30.663475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-296b93c5-c981-45ec-8e88-e029b3efbf16 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:30.815710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-296b93c5-c981-45ec-8e88-e029b3efbf16 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:30.823259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-296b93c5-c981-45ec-8e88-e029b3efbf16 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.179291 Feb 21 00:38:30.824636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 135/248] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:30 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:31.839329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f3630fc6-c410-417f-b7f8-80d7376f9dda tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:31.840600 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f3630fc6-c410-417f-b7f8-80d7376f9dda tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:31.847247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f3630fc6-c410-417f-b7f8-80d7376f9dda tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:31.847697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f3630fc6-c410-417f-b7f8-80d7376f9dda tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:31.848505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f3630fc6-c410-417f-b7f8-80d7376f9dda tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:31.849111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f3630fc6-c410-417f-b7f8-80d7376f9dda tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:32.014367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f3630fc6-c410-417f-b7f8-80d7376f9dda tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:32.022016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f3630fc6-c410-417f-b7f8-80d7376f9dda tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1501 microversion: 2.1 time: 0.186462 Feb 21 00:38:32.022667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 114/249] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:31 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:32.038789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f439ebc-8d43-4f36-9006-372114cb2344"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:38:32.039845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:32.045848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:32.046373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:32.047338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:32.047769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:32.070912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] HTTP exception thrown: Cannot 'attach_volume' instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 while it is in vm_state rescued Feb 21 00:38:32.075387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Returning 409 to user: Cannot 'attach_volume' instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 while it is in vm_state rescued {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:38:32.075387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-67818397-1706-4651-9c45-1201f7f51ae7 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039237 Feb 21 00:38:32.075387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 136/250] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 00:38:32 2022] POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 21 00:38:32.083205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-73e2095c-0534-4177-b725-aa102fa9e1ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:38:32.083617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-73e2095c-0534-4177-b725-aa102fa9e1ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:32.089716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73e2095c-0534-4177-b725-aa102fa9e1ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:32.090154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73e2095c-0534-4177-b725-aa102fa9e1ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:32.090922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73e2095c-0534-4177-b725-aa102fa9e1ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:32.091342 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73e2095c-0534-4177-b725-aa102fa9e1ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:32.161098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-73e2095c-0534-4177-b725-aa102fa9e1ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/action" status: 202 len: 0 microversion: 2.1 time: 0.081669 Feb 21 00:38:32.162444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 115/251] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:38:32 2022] POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:38:32.170301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7e693c80-a89c-45d7-9d9d-be2d52ee6e1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:32.171153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7e693c80-a89c-45d7-9d9d-be2d52ee6e1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:32.177459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7e693c80-a89c-45d7-9d9d-be2d52ee6e1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:32.178309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7e693c80-a89c-45d7-9d9d-be2d52ee6e1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:32.179286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7e693c80-a89c-45d7-9d9d-be2d52ee6e1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:32.179720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7e693c80-a89c-45d7-9d9d-be2d52ee6e1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:32.343133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7e693c80-a89c-45d7-9d9d-be2d52ee6e1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:32.351831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7e693c80-a89c-45d7-9d9d-be2d52ee6e1b tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.185288 Feb 21 00:38:32.352665 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 137/252] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:32 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:38:33.369661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-186185aa-7b45-4393-a719-30ef4f5a0113 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:33.370469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-186185aa-7b45-4393-a719-30ef4f5a0113 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:33.377378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-186185aa-7b45-4393-a719-30ef4f5a0113 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:33.377900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-186185aa-7b45-4393-a719-30ef4f5a0113 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:33.378682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-186185aa-7b45-4393-a719-30ef4f5a0113 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:33.379110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-186185aa-7b45-4393-a719-30ef4f5a0113 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:33.522316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-186185aa-7b45-4393-a719-30ef4f5a0113 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:33.529816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-186185aa-7b45-4393-a719-30ef4f5a0113 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.164023 Feb 21 00:38:33.534121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 116/253] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:33 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:34.548463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cb10c76c-5074-447b-9273-233d404c4d20 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:34.549368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cb10c76c-5074-447b-9273-233d404c4d20 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:34.558463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb10c76c-5074-447b-9273-233d404c4d20 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:34.558978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb10c76c-5074-447b-9273-233d404c4d20 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:34.559752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb10c76c-5074-447b-9273-233d404c4d20 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:34.560168 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb10c76c-5074-447b-9273-233d404c4d20 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:34.690934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cb10c76c-5074-447b-9273-233d404c4d20 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:34.698548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cb10c76c-5074-447b-9273-233d404c4d20 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.155250 Feb 21 00:38:34.699316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 138/254] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:34 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:35.715331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-11302c3e-d9c3-4e08-aa1a-9994cfb9b09c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:35.716071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-11302c3e-d9c3-4e08-aa1a-9994cfb9b09c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:35.722641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-11302c3e-d9c3-4e08-aa1a-9994cfb9b09c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:35.723087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-11302c3e-d9c3-4e08-aa1a-9994cfb9b09c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:35.723857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-11302c3e-d9c3-4e08-aa1a-9994cfb9b09c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:35.724481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-11302c3e-d9c3-4e08-aa1a-9994cfb9b09c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:35.862618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-11302c3e-d9c3-4e08-aa1a-9994cfb9b09c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:35.870052 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-11302c3e-d9c3-4e08-aa1a-9994cfb9b09c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.158557 Feb 21 00:38:35.870602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 117/255] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:35 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:36.887335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-46c351ec-a230-4e2d-b0f0-4d363dad120e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:36.888019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-46c351ec-a230-4e2d-b0f0-4d363dad120e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:36.893942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46c351ec-a230-4e2d-b0f0-4d363dad120e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:36.894387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46c351ec-a230-4e2d-b0f0-4d363dad120e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:36.895162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46c351ec-a230-4e2d-b0f0-4d363dad120e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:36.895572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46c351ec-a230-4e2d-b0f0-4d363dad120e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:37.033551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-46c351ec-a230-4e2d-b0f0-4d363dad120e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:37.042669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-46c351ec-a230-4e2d-b0f0-4d363dad120e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.159257 Feb 21 00:38:37.043414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 139/256] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:36 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:38.059139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cf27fa6b-f764-4d51-b64f-cd8992a0bbf6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:38.059744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cf27fa6b-f764-4d51-b64f-cd8992a0bbf6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:38.073921 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cf27fa6b-f764-4d51-b64f-cd8992a0bbf6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:38.074449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cf27fa6b-f764-4d51-b64f-cd8992a0bbf6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:38.075144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cf27fa6b-f764-4d51-b64f-cd8992a0bbf6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:38.075865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cf27fa6b-f764-4d51-b64f-cd8992a0bbf6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:38.210709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cf27fa6b-f764-4d51-b64f-cd8992a0bbf6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:38.217971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cf27fa6b-f764-4d51-b64f-cd8992a0bbf6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.162606 Feb 21 00:38:38.218516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 118/257] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:38 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:39.236674 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9a3c3cca-e641-4e5a-ab07-93da6bb02dc9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:39.237249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9a3c3cca-e641-4e5a-ab07-93da6bb02dc9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:39.243579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a3c3cca-e641-4e5a-ab07-93da6bb02dc9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:39.244019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a3c3cca-e641-4e5a-ab07-93da6bb02dc9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:39.244839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a3c3cca-e641-4e5a-ab07-93da6bb02dc9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:39.245266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a3c3cca-e641-4e5a-ab07-93da6bb02dc9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:39.379343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9a3c3cca-e641-4e5a-ab07-93da6bb02dc9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:39.387981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9a3c3cca-e641-4e5a-ab07-93da6bb02dc9 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.156161 Feb 21 00:38:39.388606 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 140/258] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:39 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:40.404780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b2cf60da-15a8-4662-911b-a45b83232d71 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:40.405381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b2cf60da-15a8-4662-911b-a45b83232d71 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:40.412197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2cf60da-15a8-4662-911b-a45b83232d71 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:40.412662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2cf60da-15a8-4662-911b-a45b83232d71 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:40.413419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2cf60da-15a8-4662-911b-a45b83232d71 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:40.413840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2cf60da-15a8-4662-911b-a45b83232d71 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:40.546451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b2cf60da-15a8-4662-911b-a45b83232d71 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:40.554191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b2cf60da-15a8-4662-911b-a45b83232d71 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.153067 Feb 21 00:38:40.554756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 119/259] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:40 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:41.571290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2ac24cb5-7945-4964-8c9a-4284f6db159e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:41.571895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2ac24cb5-7945-4964-8c9a-4284f6db159e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:41.578156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ac24cb5-7945-4964-8c9a-4284f6db159e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:41.578578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ac24cb5-7945-4964-8c9a-4284f6db159e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:41.579343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ac24cb5-7945-4964-8c9a-4284f6db159e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:41.579839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ac24cb5-7945-4964-8c9a-4284f6db159e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:41.723353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2ac24cb5-7945-4964-8c9a-4284f6db159e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:41.730850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2ac24cb5-7945-4964-8c9a-4284f6db159e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1509 microversion: 2.1 time: 0.163392 Feb 21 00:38:41.731426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 141/260] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:41 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:42.751853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3dda37ba-b2a2-4197-966f-123dacd53d57 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:42.753047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3dda37ba-b2a2-4197-966f-123dacd53d57 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:42.760275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3dda37ba-b2a2-4197-966f-123dacd53d57 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:42.760835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3dda37ba-b2a2-4197-966f-123dacd53d57 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:42.761737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3dda37ba-b2a2-4197-966f-123dacd53d57 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:42.762234 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3dda37ba-b2a2-4197-966f-123dacd53d57 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:42.902447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3dda37ba-b2a2-4197-966f-123dacd53d57 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:42.910054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3dda37ba-b2a2-4197-966f-123dacd53d57 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1515 microversion: 2.1 time: 0.164428 Feb 21 00:38:42.910646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 120/261] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:42 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:49.482002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fb21c9b5-cc2a-40e4-b894-58540f32b1a0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:38:49.483199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fb21c9b5-cc2a-40e4-b894-58540f32b1a0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:49.489380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb21c9b5-cc2a-40e4-b894-58540f32b1a0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:49.489823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb21c9b5-cc2a-40e4-b894-58540f32b1a0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:49.490593 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb21c9b5-cc2a-40e4-b894-58540f32b1a0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:49.491067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb21c9b5-cc2a-40e4-b894-58540f32b1a0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:49.626257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb21c9b5-cc2a-40e4-b894-58540f32b1a0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:38:49.633700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fb21c9b5-cc2a-40e4-b894-58540f32b1a0 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1515 microversion: 2.1 time: 0.155731 Feb 21 00:38:49.634257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 142/262] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:38:49 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:38:49.649371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3ec0f12f-e12b-4487-8496-c9251fd83ab3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d3e3aea-9a2d-447c-9560-23b806318427"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:38:49.650419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3ec0f12f-e12b-4487-8496-c9251fd83ab3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:38:49.656944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ec0f12f-e12b-4487-8496-c9251fd83ab3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:49.657420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ec0f12f-e12b-4487-8496-c9251fd83ab3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:49.658194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ec0f12f-e12b-4487-8496-c9251fd83ab3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:38:49.658612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ec0f12f-e12b-4487-8496-c9251fd83ab3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:38:51.267338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3ec0f12f-e12b-4487-8496-c9251fd83ab3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.621516 Feb 21 00:38:51.268676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 121/263] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 00:38:49 2022] POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments => generated 194 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:39:07.468053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-89d20b83-119c-4024-8657-49b8c57a020f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:07.469930 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-89d20b83-119c-4024-8657-49b8c57a020f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:07.476935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89d20b83-119c-4024-8657-49b8c57a020f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:07.477609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89d20b83-119c-4024-8657-49b8c57a020f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:07.479190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89d20b83-119c-4024-8657-49b8c57a020f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:07.479786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89d20b83-119c-4024-8657-49b8c57a020f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:07.513163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-89d20b83-119c-4024-8657-49b8c57a020f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lazy-loading 'flavor' on Instance uuid 2bedd6d6-814a-48db-a1ca-b35b01e44759 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:39:07.608321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-868679fc-9e72-4f5c-bd62-0219f7e2f17a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Action: 'create', calling method: .version_select at 0x7fe56ef59e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1668814767"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:07.638368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-868679fc-9e72-4f5c-bd62-0219f7e2f17a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Getting quotas for project edeb7d92f478431e94fea34d24389a5e. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:39:07.644605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-868679fc-9e72-4f5c-bd62-0219f7e2f17a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Getting quotas for user 6c50243a8d4b447bb5d6b5a811cb28fc and project edeb7d92f478431e94fea34d24389a5e. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:39:07.678377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-89d20b83-119c-4024-8657-49b8c57a020f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/action" status: 200 len: 32 microversion: 2.1 time: 0.214143 Feb 21 00:39:07.680806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 122/264] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:39:07 2022] POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 00:39:07.705480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-56330004-f279-460c-89af-0a6628e3db1f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:07.706310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-56330004-f279-460c-89af-0a6628e3db1f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:07.716946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56330004-f279-460c-89af-0a6628e3db1f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:07.718660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56330004-f279-460c-89af-0a6628e3db1f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:07.720431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56330004-f279-460c-89af-0a6628e3db1f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:07.721132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56330004-f279-460c-89af-0a6628e3db1f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:08.041834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-56330004-f279-460c-89af-0a6628e3db1f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:08.057157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-56330004-f279-460c-89af-0a6628e3db1f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.359616 Feb 21 00:39:08.058902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 123/265] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:07 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:08.139537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-868679fc-9e72-4f5c-bd62-0219f7e2f17a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Getting quotas for project edeb7d92f478431e94fea34d24389a5e. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:39:08.144008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-868679fc-9e72-4f5c-bd62-0219f7e2f17a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Getting quotas for user 6c50243a8d4b447bb5d6b5a811cb28fc and project edeb7d92f478431e94fea34d24389a5e. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:39:08.158880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-868679fc-9e72-4f5c-bd62-0219f7e2f17a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.780061 Feb 21 00:39:08.159465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 143/266] 10.222.0.72 () {60 vars in 1157 bytes} [Mon Feb 21 00:39:07 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:09.075375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-935ddfa4-9bdd-441c-833e-3e3f02bd4eb5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:09.075987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-935ddfa4-9bdd-441c-833e-3e3f02bd4eb5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:09.082398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-935ddfa4-9bdd-441c-833e-3e3f02bd4eb5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:09.082845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-935ddfa4-9bdd-441c-833e-3e3f02bd4eb5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:09.083622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-935ddfa4-9bdd-441c-833e-3e3f02bd4eb5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:09.084047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-935ddfa4-9bdd-441c-833e-3e3f02bd4eb5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:09.291122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-935ddfa4-9bdd-441c-833e-3e3f02bd4eb5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:09.299051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-935ddfa4-9bdd-441c-833e-3e3f02bd4eb5 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.227702 Feb 21 00:39:09.308752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 124/267] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:09 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:10.317119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6c812d87-edec-4db2-8357-1ebde3268f35 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:10.319527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6c812d87-edec-4db2-8357-1ebde3268f35 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:10.328019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6c812d87-edec-4db2-8357-1ebde3268f35 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:10.328768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6c812d87-edec-4db2-8357-1ebde3268f35 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:10.329806 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6c812d87-edec-4db2-8357-1ebde3268f35 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:10.330380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6c812d87-edec-4db2-8357-1ebde3268f35 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:10.516709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6c812d87-edec-4db2-8357-1ebde3268f35 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:10.526464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6c812d87-edec-4db2-8357-1ebde3268f35 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.215176 Feb 21 00:39:10.527625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 144/268] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:10 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:11.544916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-40190a21-037d-478b-b465-7ac7cd4d2580 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:11.545455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-40190a21-037d-478b-b465-7ac7cd4d2580 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:11.552110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-40190a21-037d-478b-b465-7ac7cd4d2580 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:11.552588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-40190a21-037d-478b-b465-7ac7cd4d2580 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:11.553365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-40190a21-037d-478b-b465-7ac7cd4d2580 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:11.553793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-40190a21-037d-478b-b465-7ac7cd4d2580 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:11.685202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-40190a21-037d-478b-b465-7ac7cd4d2580 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:11.693299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-40190a21-037d-478b-b465-7ac7cd4d2580 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.152219 Feb 21 00:39:11.693865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 125/269] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:11 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:39:12.710289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c0bf4d06-a1e4-4c11-b938-d3ce3f9956af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:12.710870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c0bf4d06-a1e4-4c11-b938-d3ce3f9956af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:12.716959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c0bf4d06-a1e4-4c11-b938-d3ce3f9956af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:12.717408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c0bf4d06-a1e4-4c11-b938-d3ce3f9956af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:12.718181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c0bf4d06-a1e4-4c11-b938-d3ce3f9956af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:12.718617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c0bf4d06-a1e4-4c11-b938-d3ce3f9956af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:12.867202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c0bf4d06-a1e4-4c11-b938-d3ce3f9956af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:12.875755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c0bf4d06-a1e4-4c11-b938-d3ce3f9956af tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.169277 Feb 21 00:39:12.876451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 145/270] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:12 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:13.899202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3a45ecdf-e96a-405f-93fd-25c1e866617f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:13.900445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3a45ecdf-e96a-405f-93fd-25c1e866617f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:13.907621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a45ecdf-e96a-405f-93fd-25c1e866617f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:13.908340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a45ecdf-e96a-405f-93fd-25c1e866617f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:13.909178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a45ecdf-e96a-405f-93fd-25c1e866617f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:13.909782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a45ecdf-e96a-405f-93fd-25c1e866617f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:14.076824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3a45ecdf-e96a-405f-93fd-25c1e866617f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:14.085046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3a45ecdf-e96a-405f-93fd-25c1e866617f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.195551 Feb 21 00:39:14.085778 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 126/271] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:13 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:15.102321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1a112ad5-8bdf-43dc-bc2f-46a1b1b0875d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:15.102941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1a112ad5-8bdf-43dc-bc2f-46a1b1b0875d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:15.110523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1a112ad5-8bdf-43dc-bc2f-46a1b1b0875d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:15.112257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1a112ad5-8bdf-43dc-bc2f-46a1b1b0875d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:15.113201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1a112ad5-8bdf-43dc-bc2f-46a1b1b0875d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:15.113637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1a112ad5-8bdf-43dc-bc2f-46a1b1b0875d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:15.284544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1a112ad5-8bdf-43dc-bc2f-46a1b1b0875d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:15.290966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1a112ad5-8bdf-43dc-bc2f-46a1b1b0875d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.192476 Feb 21 00:39:15.291562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 146/272] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:15 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:16.308002 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-761a4edb-da1a-477e-802e-d7f5c38e9050 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:16.308662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-761a4edb-da1a-477e-802e-d7f5c38e9050 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:16.315997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-761a4edb-da1a-477e-802e-d7f5c38e9050 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:16.316731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-761a4edb-da1a-477e-802e-d7f5c38e9050 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:16.317798 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-761a4edb-da1a-477e-802e-d7f5c38e9050 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:16.318223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-761a4edb-da1a-477e-802e-d7f5c38e9050 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:16.466546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-761a4edb-da1a-477e-802e-d7f5c38e9050 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:16.475949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-761a4edb-da1a-477e-802e-d7f5c38e9050 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.171395 Feb 21 00:39:16.487575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 127/273] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:16 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:17.493942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-378d7cdf-d1c7-49d0-8b0d-9f727d3b7754 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:17.494541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-378d7cdf-d1c7-49d0-8b0d-9f727d3b7754 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:17.501143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378d7cdf-d1c7-49d0-8b0d-9f727d3b7754 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:17.501591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378d7cdf-d1c7-49d0-8b0d-9f727d3b7754 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:17.502445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378d7cdf-d1c7-49d0-8b0d-9f727d3b7754 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:17.502879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378d7cdf-d1c7-49d0-8b0d-9f727d3b7754 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:17.650472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-378d7cdf-d1c7-49d0-8b0d-9f727d3b7754 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:17.658848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-378d7cdf-d1c7-49d0-8b0d-9f727d3b7754 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.168720 Feb 21 00:39:17.659421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 147/274] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:17 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:18.676601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-83208b11-37ca-4343-93d0-fd34fcda1bcb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:18.677946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-83208b11-37ca-4343-93d0-fd34fcda1bcb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:18.690043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83208b11-37ca-4343-93d0-fd34fcda1bcb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:18.690763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83208b11-37ca-4343-93d0-fd34fcda1bcb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:18.691752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83208b11-37ca-4343-93d0-fd34fcda1bcb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:18.692841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83208b11-37ca-4343-93d0-fd34fcda1bcb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:18.935999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-83208b11-37ca-4343-93d0-fd34fcda1bcb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:18.947719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-83208b11-37ca-4343-93d0-fd34fcda1bcb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.275364 Feb 21 00:39:18.948917 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 128/275] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:18 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:19.965164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-16219925-964a-43f6-8031-1b239995ddce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:19.965774 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-16219925-964a-43f6-8031-1b239995ddce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:19.973883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16219925-964a-43f6-8031-1b239995ddce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:19.976652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16219925-964a-43f6-8031-1b239995ddce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:19.977801 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16219925-964a-43f6-8031-1b239995ddce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:19.978447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16219925-964a-43f6-8031-1b239995ddce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:20.195980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-16219925-964a-43f6-8031-1b239995ddce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:20.212745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-16219925-964a-43f6-8031-1b239995ddce tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.250180 Feb 21 00:39:20.223255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 148/276] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:19 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:21.230576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dd34799a-0b1b-4901-b655-879e455b2fee tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:21.231758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dd34799a-0b1b-4901-b655-879e455b2fee tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:21.239683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dd34799a-0b1b-4901-b655-879e455b2fee tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:21.242588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dd34799a-0b1b-4901-b655-879e455b2fee tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:21.243723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dd34799a-0b1b-4901-b655-879e455b2fee tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:21.245728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dd34799a-0b1b-4901-b655-879e455b2fee tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:21.556559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dd34799a-0b1b-4901-b655-879e455b2fee tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:21.568861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dd34799a-0b1b-4901-b655-879e455b2fee tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.341752 Feb 21 00:39:21.571044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 129/277] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:21 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:22.592461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-227ac5eb-4520-4623-a337-faea87f3998e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:22.593204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-227ac5eb-4520-4623-a337-faea87f3998e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:22.605728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-227ac5eb-4520-4623-a337-faea87f3998e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:22.606315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-227ac5eb-4520-4623-a337-faea87f3998e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:22.607261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-227ac5eb-4520-4623-a337-faea87f3998e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:22.607956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-227ac5eb-4520-4623-a337-faea87f3998e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:22.892145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-227ac5eb-4520-4623-a337-faea87f3998e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:22.906652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-227ac5eb-4520-4623-a337-faea87f3998e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.323567 Feb 21 00:39:22.907897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 149/278] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:22 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:23.926844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-57f750b5-07a9-4b56-9c06-6df68febb2ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:23.927468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-57f750b5-07a9-4b56-9c06-6df68febb2ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:23.934118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57f750b5-07a9-4b56-9c06-6df68febb2ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:23.934620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57f750b5-07a9-4b56-9c06-6df68febb2ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:23.935405 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57f750b5-07a9-4b56-9c06-6df68febb2ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:23.935837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57f750b5-07a9-4b56-9c06-6df68febb2ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:24.455930 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-57f750b5-07a9-4b56-9c06-6df68febb2ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:24.464300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-57f750b5-07a9-4b56-9c06-6df68febb2ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.542333 Feb 21 00:39:24.465522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 130/279] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:23 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:39:25.481643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b1d47fca-bb42-4473-9bb0-a1015ed6d60c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:25.482237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b1d47fca-bb42-4473-9bb0-a1015ed6d60c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:25.491500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b1d47fca-bb42-4473-9bb0-a1015ed6d60c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:25.493515 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b1d47fca-bb42-4473-9bb0-a1015ed6d60c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:25.494254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b1d47fca-bb42-4473-9bb0-a1015ed6d60c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:25.494685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b1d47fca-bb42-4473-9bb0-a1015ed6d60c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:26.006822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b1d47fca-bb42-4473-9bb0-a1015ed6d60c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:26.021211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b1d47fca-bb42-4473-9bb0-a1015ed6d60c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1567 microversion: 2.1 time: 0.543179 Feb 21 00:39:26.030660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 150/280] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:25 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1567 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:27.038730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-66ff2352-10aa-40ca-b2df-e0f755f2314d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:27.039664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-66ff2352-10aa-40ca-b2df-e0f755f2314d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:27.070510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-66ff2352-10aa-40ca-b2df-e0f755f2314d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:27.071090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-66ff2352-10aa-40ca-b2df-e0f755f2314d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:27.071950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-66ff2352-10aa-40ca-b2df-e0f755f2314d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:27.072382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-66ff2352-10aa-40ca-b2df-e0f755f2314d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:28.027628 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-66ff2352-10aa-40ca-b2df-e0f755f2314d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:28.038876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-66ff2352-10aa-40ca-b2df-e0f755f2314d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1547 microversion: 2.1 time: 1.004151 Feb 21 00:39:28.052513 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 131/281] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:27 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1547 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:28.056795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:28.057276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:28.067681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:28.068126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:28.068955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:28.069391 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:28.398811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] HTTP exception thrown: Cannot 'detach_volume' instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 while it is in vm_state rescued Feb 21 00:39:28.404255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Returning 409 to user: Cannot 'detach_volume' instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 while it is in vm_state rescued {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:39:28.407214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c3027f78-af5e-44e3-912f-32c143a31155 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments/5d3e3aea-9a2d-447c-9560-23b806318427" status: 409 len: 152 microversion: 2.1 time: 0.352356 Feb 21 00:39:28.411333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 151/282] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:39:28 2022] DELETE /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments/5d3e3aea-9a2d-447c-9560-23b806318427 => generated 152 bytes in 356 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 21 00:39:28.417687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-eba47016-f2d1-425a-9150-89610dfedc13 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:28.418230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-eba47016-f2d1-425a-9150-89610dfedc13 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:28.428267 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eba47016-f2d1-425a-9150-89610dfedc13 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:28.428752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eba47016-f2d1-425a-9150-89610dfedc13 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:28.429549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eba47016-f2d1-425a-9150-89610dfedc13 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:28.429986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eba47016-f2d1-425a-9150-89610dfedc13 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:28.580843 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-eba47016-f2d1-425a-9150-89610dfedc13 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/action" status: 202 len: 0 microversion: 2.1 time: 0.167350 Feb 21 00:39:28.582191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 132/283] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:39:28 2022] POST /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:39:28.589954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6cd47ccd-f8dd-4db5-9a77-fbda70cf2260 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:28.591388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6cd47ccd-f8dd-4db5-9a77-fbda70cf2260 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:28.604484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6cd47ccd-f8dd-4db5-9a77-fbda70cf2260 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:28.606225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6cd47ccd-f8dd-4db5-9a77-fbda70cf2260 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:28.609072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6cd47ccd-f8dd-4db5-9a77-fbda70cf2260 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:28.609857 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6cd47ccd-f8dd-4db5-9a77-fbda70cf2260 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:29.386185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6cd47ccd-f8dd-4db5-9a77-fbda70cf2260 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:29.399731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6cd47ccd-f8dd-4db5-9a77-fbda70cf2260 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1555 microversion: 2.1 time: 0.810385 Feb 21 00:39:29.410385 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 152/284] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:28 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1555 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:30.420885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-eed02109-ed77-42a9-a228-46a50e1328ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:30.421584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-eed02109-ed77-42a9-a228-46a50e1328ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:30.436370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eed02109-ed77-42a9-a228-46a50e1328ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:30.437100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eed02109-ed77-42a9-a228-46a50e1328ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:30.440706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eed02109-ed77-42a9-a228-46a50e1328ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:30.441325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eed02109-ed77-42a9-a228-46a50e1328ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:30.858977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eed02109-ed77-42a9-a228-46a50e1328ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:30.874206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-eed02109-ed77-42a9-a228-46a50e1328ec tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1555 microversion: 2.1 time: 0.451226 Feb 21 00:39:30.874962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 133/285] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:30 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1555 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:31.891969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-274ea9bd-5241-44d3-955f-4cf7eaecbb47 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:31.892610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-274ea9bd-5241-44d3-955f-4cf7eaecbb47 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:31.903767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-274ea9bd-5241-44d3-955f-4cf7eaecbb47 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:31.904217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-274ea9bd-5241-44d3-955f-4cf7eaecbb47 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:31.905714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-274ea9bd-5241-44d3-955f-4cf7eaecbb47 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:31.905714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-274ea9bd-5241-44d3-955f-4cf7eaecbb47 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:32.418851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-274ea9bd-5241-44d3-955f-4cf7eaecbb47 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:32.427923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-274ea9bd-5241-44d3-955f-4cf7eaecbb47 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1555 microversion: 2.1 time: 0.539559 Feb 21 00:39:32.428817 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 153/286] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:31 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1555 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:32.874437 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0d630759-c980-4220-aae1-7c5466b8c642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Action: 'create', calling method: .version_select at 0x7fe56d54c3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1495553514"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:32.952496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-0d630759-c980-4220-aae1-7c5466b8c642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Getting quotas for project 7d143cea723743ada5bdde1be0b26db4. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:39:32.969943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-0d630759-c980-4220-aae1-7c5466b8c642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Getting quotas for user 01450ffdb03d4d51b6c96024085b1cf5 and project 7d143cea723743ada5bdde1be0b26db4. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:39:33.214960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-0d630759-c980-4220-aae1-7c5466b8c642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Getting quotas for project 7d143cea723743ada5bdde1be0b26db4. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:39:33.221761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-0d630759-c980-4220-aae1-7c5466b8c642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Getting quotas for user 01450ffdb03d4d51b6c96024085b1cf5 and project 7d143cea723743ada5bdde1be0b26db4. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:39:33.240835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0d630759-c980-4220-aae1-7c5466b8c642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.692104 Feb 21 00:39:33.246764 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 134/287] 10.222.0.72 () {60 vars in 1157 bytes} [Mon Feb 21 00:39:32 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:33.446108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bb06ddb1-d544-441c-85e5-596cb5fd7b0e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:33.446751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bb06ddb1-d544-441c-85e5-596cb5fd7b0e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:33.470089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb06ddb1-d544-441c-85e5-596cb5fd7b0e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:33.470541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb06ddb1-d544-441c-85e5-596cb5fd7b0e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:33.471351 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb06ddb1-d544-441c-85e5-596cb5fd7b0e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:33.474052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb06ddb1-d544-441c-85e5-596cb5fd7b0e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:33.859343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb06ddb1-d544-441c-85e5-596cb5fd7b0e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:33.874667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bb06ddb1-d544-441c-85e5-596cb5fd7b0e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1561 microversion: 2.1 time: 0.429440 Feb 21 00:39:33.876283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 154/288] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:33 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1561 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:33.999857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-445cb813-d367-4bf7-b2ef-5d7b87aabfa4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:34.001024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-445cb813-d367-4bf7-b2ef-5d7b87aabfa4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:34.010992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-445cb813-d367-4bf7-b2ef-5d7b87aabfa4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:34.011791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-445cb813-d367-4bf7-b2ef-5d7b87aabfa4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:34.013168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-445cb813-d367-4bf7-b2ef-5d7b87aabfa4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:34.013944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-445cb813-d367-4bf7-b2ef-5d7b87aabfa4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:34.214795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-445cb813-d367-4bf7-b2ef-5d7b87aabfa4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lazy-loading 'services' on Instance uuid 2bedd6d6-814a-48db-a1ca-b35b01e44759 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:39:34.386210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-445cb813-d367-4bf7-b2ef-5d7b87aabfa4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments/5d3e3aea-9a2d-447c-9560-23b806318427" status: 202 len: 0 microversion: 2.1 time: 0.393183 Feb 21 00:39:34.386811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 135/289] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:39:33 2022] DELETE /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments/5d3e3aea-9a2d-447c-9560-23b806318427 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:39:34.395120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-970ce448-9512-4a24-a85f-baad945f6f9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:34.396097 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-970ce448-9512-4a24-a85f-baad945f6f9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:34.403349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-970ce448-9512-4a24-a85f-baad945f6f9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:34.404082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-970ce448-9512-4a24-a85f-baad945f6f9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:34.404876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-970ce448-9512-4a24-a85f-baad945f6f9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:34.405310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-970ce448-9512-4a24-a85f-baad945f6f9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:34.490833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-970ce448-9512-4a24-a85f-baad945f6f9c tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099355 Feb 21 00:39:34.494806 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 155/290] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:39:34 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:39:34.811271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1778450166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1668814767", "security_groups": [{"name": "tempest-secgroup-smoke-529075187"}], "networks": [{"uuid": "37808ad9-f13a-4692-ad2d-763757b7e60a"}], "block_device_mapping_v2": [{"uuid": "4488700e-155f-47cc-adb3-7a5617d9dd99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:35.097037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.network.neutron [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] validate_networks() for [('37808ad9-f13a-4692-ad2d-763757b7e60a', None, None, None, None, None)] {{(pid=123097) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:39:35.502394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-24dfbdfd-fd61-4606-8699-b34cc24464cb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:35.511684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-24dfbdfd-fd61-4606-8699-b34cc24464cb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:35.524469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24dfbdfd-fd61-4606-8699-b34cc24464cb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:35.525481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24dfbdfd-fd61-4606-8699-b34cc24464cb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:35.527150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24dfbdfd-fd61-4606-8699-b34cc24464cb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:35.527745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24dfbdfd-fd61-4606-8699-b34cc24464cb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:35.642929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-24dfbdfd-fd61-4606-8699-b34cc24464cb tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144291 Feb 21 00:39:35.647884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 156/291] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:39:35 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 00:39:36.355954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Flavor limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:39:36.357174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Image limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:39:36.360532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Flavor pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:39:36.361148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Image pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:39:36.361721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:39:36.380200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:36.386193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:36.389881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:36.392880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:36.449297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Getting quotas for project edeb7d92f478431e94fea34d24389a5e. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:39:36.455248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Getting quotas for user 6c50243a8d4b447bb5d6b5a811cb28fc and project edeb7d92f478431e94fea34d24389a5e. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:39:36.591770 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Going to run 1 instances... {{(pid=123097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:39:36.599048 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4488700e-155f-47cc-adb3-7a5617d9dd99',volume_size=None,volume_type=None)] {{(pid=123097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:39:36.887091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [049d63c8-41c5-4764-8917-2c00f8d1a18d] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 00:39:37.895246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [049d63c8-41c5-4764-8917-2c00f8d1a18d] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 60202. Feb 21 00:39:37.901419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b15b939d-0971-47b4-8a2d-3570e98cbbe4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.094548 Feb 21 00:39:37.902322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 136/292] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:39:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 3096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 00:39:37.924129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c22e9c87-3bfd-41aa-ba91-c794a5fe933d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:37.924832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c22e9c87-3bfd-41aa-ba91-c794a5fe933d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:37.995648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c22e9c87-3bfd-41aa-ba91-c794a5fe933d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:38.004772 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c22e9c87-3bfd-41aa-ba91-c794a5fe933d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1089 microversion: 2.1 time: 0.094090 Feb 21 00:39:38.005367 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 157/293] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1089 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:38.385163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-32973e8f-46ed-4300-9cb7-0a0f4b5d1fea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:38.385966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-32973e8f-46ed-4300-9cb7-0a0f4b5d1fea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:38.411379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32973e8f-46ed-4300-9cb7-0a0f4b5d1fea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:38.415983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32973e8f-46ed-4300-9cb7-0a0f4b5d1fea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:38.417820 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32973e8f-46ed-4300-9cb7-0a0f4b5d1fea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:38.419645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32973e8f-46ed-4300-9cb7-0a0f4b5d1fea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:38.502424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-32973e8f-46ed-4300-9cb7-0a0f4b5d1fea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:39:38.724712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-32973e8f-46ed-4300-9cb7-0a0f4b5d1fea tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 204 len: 0 microversion: 2.1 time: 0.343187 Feb 21 00:39:38.727457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 137/294] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:39:38 2022] DELETE /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:39:38.738298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-96ed7505-bd00-4e54-ac62-a25c677ebf69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:38.739162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-96ed7505-bd00-4e54-ac62-a25c677ebf69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:38.756870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96ed7505-bd00-4e54-ac62-a25c677ebf69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:38.757381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96ed7505-bd00-4e54-ac62-a25c677ebf69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:38.765753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96ed7505-bd00-4e54-ac62-a25c677ebf69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:38.767384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96ed7505-bd00-4e54-ac62-a25c677ebf69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:39.009898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-96ed7505-bd00-4e54-ac62-a25c677ebf69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:39.022279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-96ed7505-bd00-4e54-ac62-a25c677ebf69 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1507 microversion: 2.1 time: 0.290517 Feb 21 00:39:39.022794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ef3843d-d885-4753-b7e1-4ddafc9caaa7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:39.023580 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6ef3843d-d885-4753-b7e1-4ddafc9caaa7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:39.034989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 158/295] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:38 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:39.035161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ef3843d-d885-4753-b7e1-4ddafc9caaa7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:39.037043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ef3843d-d885-4753-b7e1-4ddafc9caaa7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:39.041650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ef3843d-d885-4753-b7e1-4ddafc9caaa7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:39.043407 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ef3843d-d885-4753-b7e1-4ddafc9caaa7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:39.150791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ef3843d-d885-4753-b7e1-4ddafc9caaa7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:39.159515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ef3843d-d885-4753-b7e1-4ddafc9caaa7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1131 microversion: 2.1 time: 0.141487 Feb 21 00:39:39.160993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 138/296] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:39 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1131 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:39:40.040169 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-42f65287-5095-48a2-9ee5-9816998d6137 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:40.040854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-42f65287-5095-48a2-9ee5-9816998d6137 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:40.050112 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42f65287-5095-48a2-9ee5-9816998d6137 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:40.050656 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42f65287-5095-48a2-9ee5-9816998d6137 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:40.051572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42f65287-5095-48a2-9ee5-9816998d6137 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:40.052298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42f65287-5095-48a2-9ee5-9816998d6137 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:40.180574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-87e430b3-f0ee-42cd-8d4e-eda95bb53209 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:40.181427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-87e430b3-f0ee-42cd-8d4e-eda95bb53209 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:40.211606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-87e430b3-f0ee-42cd-8d4e-eda95bb53209 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:40.228293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-87e430b3-f0ee-42cd-8d4e-eda95bb53209 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:40.238885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-87e430b3-f0ee-42cd-8d4e-eda95bb53209 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:40.239483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-87e430b3-f0ee-42cd-8d4e-eda95bb53209 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:40.338312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-42f65287-5095-48a2-9ee5-9816998d6137 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:40.357837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-42f65287-5095-48a2-9ee5-9816998d6137 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1507 microversion: 2.1 time: 0.321525 Feb 21 00:39:40.359413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 159/297] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:40 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:40.566672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-87e430b3-f0ee-42cd-8d4e-eda95bb53209 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:40.575129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-87e430b3-f0ee-42cd-8d4e-eda95bb53209 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1195 microversion: 2.1 time: 0.400116 Feb 21 00:39:40.586553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 139/298] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:40 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1195 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:41.376620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e74050e8-20a6-4d40-860e-6cea982f79ac tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:41.378084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e74050e8-20a6-4d40-860e-6cea982f79ac tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:41.400470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e74050e8-20a6-4d40-860e-6cea982f79ac tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:41.403900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e74050e8-20a6-4d40-860e-6cea982f79ac tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:41.407700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e74050e8-20a6-4d40-860e-6cea982f79ac tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:41.411465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e74050e8-20a6-4d40-860e-6cea982f79ac tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:41.592444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fabc12d6-446b-4833-9402-e7d55df8b4f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:41.594893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fabc12d6-446b-4833-9402-e7d55df8b4f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:41.605455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fabc12d6-446b-4833-9402-e7d55df8b4f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:41.615591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fabc12d6-446b-4833-9402-e7d55df8b4f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:41.617191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fabc12d6-446b-4833-9402-e7d55df8b4f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:41.617826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fabc12d6-446b-4833-9402-e7d55df8b4f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:41.799041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e74050e8-20a6-4d40-860e-6cea982f79ac tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:41.809972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e74050e8-20a6-4d40-860e-6cea982f79ac tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1507 microversion: 2.1 time: 0.437297 Feb 21 00:39:41.811395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 160/299] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:41 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1507 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:42.176907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fabc12d6-446b-4833-9402-e7d55df8b4f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:42.184537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fabc12d6-446b-4833-9402-e7d55df8b4f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.595724 Feb 21 00:39:42.187847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 140/300] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:39:42.827669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5b22b2b8-8d40-4a29-b256-48c30f5c99b6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:42.829721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5b22b2b8-8d40-4a29-b256-48c30f5c99b6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:42.860107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b22b2b8-8d40-4a29-b256-48c30f5c99b6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:42.862479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b22b2b8-8d40-4a29-b256-48c30f5c99b6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:42.875068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b22b2b8-8d40-4a29-b256-48c30f5c99b6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:42.876493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b22b2b8-8d40-4a29-b256-48c30f5c99b6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:43.139734 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-ea740aa5-137a-4d01-acd8-63a3c93d62bf req-8fad5494-bebd-4372-8f00-06d157a5f752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d201f02-8582-4720-942e-8d62400e176f", "tag": "bf929627-3fbe-4a88-9f95-bbe9870fa556"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:43.141254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:39:43.141254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:39:43.163274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-ea740aa5-137a-4d01-acd8-63a3c93d62bf req-8fad5494-bebd-4372-8f00-06d157a5f752 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:43.163900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-ea740aa5-137a-4d01-acd8-63a3c93d62bf req-8fad5494-bebd-4372-8f00-06d157a5f752 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:43.177725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-ea740aa5-137a-4d01-acd8-63a3c93d62bf req-8fad5494-bebd-4372-8f00-06d157a5f752 service nova] Creating event network-changed:bf929627-3fbe-4a88-9f95-bbe9870fa556 for instance 9d201f02-8582-4720-942e-8d62400e176f on hv-cinder-81322 Feb 21 00:39:43.186445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-ea740aa5-137a-4d01-acd8-63a3c93d62bf req-8fad5494-bebd-4372-8f00-06d157a5f752 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052423 Feb 21 00:39:43.187984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5b22b2b8-8d40-4a29-b256-48c30f5c99b6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:43.192544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 141/301] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:39:43.196675 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5b22b2b8-8d40-4a29-b256-48c30f5c99b6 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1465 microversion: 2.1 time: 0.373296 Feb 21 00:39:43.201851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 161/302] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:42 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1465 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:43.202593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5906a6d4-8ac7-4e19-8e20-027b93abd05b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:43.203454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5906a6d4-8ac7-4e19-8e20-027b93abd05b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:43.211914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5906a6d4-8ac7-4e19-8e20-027b93abd05b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:43.212698 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5906a6d4-8ac7-4e19-8e20-027b93abd05b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:43.213702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5906a6d4-8ac7-4e19-8e20-027b93abd05b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:43.214271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5906a6d4-8ac7-4e19-8e20-027b93abd05b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:43.391298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-eac3addf-3f8f-4cfa-9a38-c7a9ac572851 req-ff8e1b2f-553c-414c-84da-6f0e509a6afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d637a83e-8fb7-4b8c-b617-e8d245844ee2", "name": "network-vif-deleted", "tag": "1cd9b49c-50c7-4d52-af67-9e9f7f069840"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:43.401362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:39:43.401362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:39:43.416358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-eac3addf-3f8f-4cfa-9a38-c7a9ac572851 req-ff8e1b2f-553c-414c-84da-6f0e509a6afa service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:43.418576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-eac3addf-3f8f-4cfa-9a38-c7a9ac572851 req-ff8e1b2f-553c-414c-84da-6f0e509a6afa service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:43.450136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-eac3addf-3f8f-4cfa-9a38-c7a9ac572851 req-ff8e1b2f-553c-414c-84da-6f0e509a6afa service nova] Creating event network-vif-deleted:1cd9b49c-50c7-4d52-af67-9e9f7f069840 for instance d637a83e-8fb7-4b8c-b617-e8d245844ee2 on hv-cinder-81322 Feb 21 00:39:43.482901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-eac3addf-3f8f-4cfa-9a38-c7a9ac572851 req-ff8e1b2f-553c-414c-84da-6f0e509a6afa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100640 Feb 21 00:39:43.488147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 162/303] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:39:43.856125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5906a6d4-8ac7-4e19-8e20-027b93abd05b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:43.875460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5906a6d4-8ac7-4e19-8e20-027b93abd05b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.677268 Feb 21 00:39:43.877968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 142/304] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:43 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:44.214235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:44.215191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:44.223566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:44.224048 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:44.231821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:44.234669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:44.318395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:44.319111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:44.319895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lazy-loading 'fault' on Instance uuid d637a83e-8fb7-4b8c-b617-e8d245844ee2 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:39:44.377119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:44.396802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2156bc63-6974-4454-8769-fd991d6358b4 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 200 len: 1312 microversion: 2.1 time: 0.186447 Feb 21 00:39:44.398492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 163/305] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:44 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:44.894940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8e04e529-4d9c-409c-b93d-28af479f6e2e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:44.897503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8e04e529-4d9c-409c-b93d-28af479f6e2e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:44.913943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e04e529-4d9c-409c-b93d-28af479f6e2e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:44.914661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e04e529-4d9c-409c-b93d-28af479f6e2e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:44.916343 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e04e529-4d9c-409c-b93d-28af479f6e2e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:44.916961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e04e529-4d9c-409c-b93d-28af479f6e2e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:45.261044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8e04e529-4d9c-409c-b93d-28af479f6e2e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:45.272602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8e04e529-4d9c-409c-b93d-28af479f6e2e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.380516 Feb 21 00:39:45.276902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 143/306] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:44 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:45.420653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:45.421411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: d637a83e-8fb7-4b8c-b617-e8d245844ee2] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:45.450458 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:45.451203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:45.462234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:45.472890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:45.487175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] HTTP exception thrown: Instance d637a83e-8fb7-4b8c-b617-e8d245844ee2 could not be found. Feb 21 00:39:45.488033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Returning 404 to user: Instance d637a83e-8fb7-4b8c-b617-e8d245844ee2 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:39:45.489304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-04156017-2440-4fc8-985c-caf89c62c5d3 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2" status: 404 len: 111 microversion: 2.1 time: 0.074014 Feb 21 00:39:45.490387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 164/307] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:45 2022] GET /compute/v2.1/servers/d637a83e-8fb7-4b8c-b617-e8d245844ee2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:39:45.502379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-54a57430-7526-4ee9-8541-75cb7c35757d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:45.503365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-54a57430-7526-4ee9-8541-75cb7c35757d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:45.518814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54a57430-7526-4ee9-8541-75cb7c35757d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:45.519391 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54a57430-7526-4ee9-8541-75cb7c35757d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:45.538953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54a57430-7526-4ee9-8541-75cb7c35757d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:45.552603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54a57430-7526-4ee9-8541-75cb7c35757d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:45.604301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-54a57430-7526-4ee9-8541-75cb7c35757d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:39:45.751350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-54a57430-7526-4ee9-8541-75cb7c35757d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 204 len: 0 microversion: 2.1 time: 0.255574 Feb 21 00:39:45.756955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 144/308] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:39:45 2022] DELETE /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:39:45.764407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-86424b41-b298-42bd-9be2-b1d3dbdfef95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:45.765134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-86424b41-b298-42bd-9be2-b1d3dbdfef95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:45.773327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86424b41-b298-42bd-9be2-b1d3dbdfef95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:45.773873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86424b41-b298-42bd-9be2-b1d3dbdfef95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:45.774754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86424b41-b298-42bd-9be2-b1d3dbdfef95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:45.775257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86424b41-b298-42bd-9be2-b1d3dbdfef95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:45.934201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-86424b41-b298-42bd-9be2-b1d3dbdfef95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:45.944996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-86424b41-b298-42bd-9be2-b1d3dbdfef95 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.184052 Feb 21 00:39:45.952764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 165/309] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:45 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:39:46.296191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9402f936-1670-49cd-8b44-e51c1eb04043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:46.298344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9402f936-1670-49cd-8b44-e51c1eb04043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:46.314274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9402f936-1670-49cd-8b44-e51c1eb04043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:46.316170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9402f936-1670-49cd-8b44-e51c1eb04043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:46.317406 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9402f936-1670-49cd-8b44-e51c1eb04043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:46.318216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9402f936-1670-49cd-8b44-e51c1eb04043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:46.561162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9402f936-1670-49cd-8b44-e51c1eb04043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:46.573840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9402f936-1670-49cd-8b44-e51c1eb04043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.284082 Feb 21 00:39:46.574418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 145/310] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:46 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:46.970591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eea8214a-fbd1-44eb-be99-f2b2c9a21a23 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:46.972074 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eea8214a-fbd1-44eb-be99-f2b2c9a21a23 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:46.979904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eea8214a-fbd1-44eb-be99-f2b2c9a21a23 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:46.980649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eea8214a-fbd1-44eb-be99-f2b2c9a21a23 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:46.981640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eea8214a-fbd1-44eb-be99-f2b2c9a21a23 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:46.982261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eea8214a-fbd1-44eb-be99-f2b2c9a21a23 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:47.189957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eea8214a-fbd1-44eb-be99-f2b2c9a21a23 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:47.197874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eea8214a-fbd1-44eb-be99-f2b2c9a21a23 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.231874 Feb 21 00:39:47.199595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 166/311] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:46 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:47.590588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0475a0be-e1c5-4fe7-a3b6-26c4e204e3ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:47.591798 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0475a0be-e1c5-4fe7-a3b6-26c4e204e3ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:47.598302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0475a0be-e1c5-4fe7-a3b6-26c4e204e3ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:47.598948 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0475a0be-e1c5-4fe7-a3b6-26c4e204e3ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:47.599999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0475a0be-e1c5-4fe7-a3b6-26c4e204e3ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:47.600671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0475a0be-e1c5-4fe7-a3b6-26c4e204e3ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:47.829859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0475a0be-e1c5-4fe7-a3b6-26c4e204e3ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:47.837691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0475a0be-e1c5-4fe7-a3b6-26c4e204e3ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.250916 Feb 21 00:39:47.848176 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 146/312] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:48.214743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b70149a3-cdeb-4c20-be5b-b74e039fb97f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:48.215353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b70149a3-cdeb-4c20-be5b-b74e039fb97f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:48.228678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b70149a3-cdeb-4c20-be5b-b74e039fb97f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:48.228678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b70149a3-cdeb-4c20-be5b-b74e039fb97f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:48.228678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b70149a3-cdeb-4c20-be5b-b74e039fb97f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:48.228678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b70149a3-cdeb-4c20-be5b-b74e039fb97f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:48.447913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b70149a3-cdeb-4c20-be5b-b74e039fb97f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:48.457540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b70149a3-cdeb-4c20-be5b-b74e039fb97f tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.245823 Feb 21 00:39:48.458420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 167/313] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:48 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:48.854931 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7087967f-6876-4c92-bb0c-d9ade52ee61b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:48.855521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7087967f-6876-4c92-bb0c-d9ade52ee61b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:48.863222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7087967f-6876-4c92-bb0c-d9ade52ee61b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:48.863796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7087967f-6876-4c92-bb0c-d9ade52ee61b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:48.864735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7087967f-6876-4c92-bb0c-d9ade52ee61b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:48.865290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7087967f-6876-4c92-bb0c-d9ade52ee61b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:49.022960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7087967f-6876-4c92-bb0c-d9ade52ee61b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:49.030772 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7087967f-6876-4c92-bb0c-d9ade52ee61b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.179306 Feb 21 00:39:49.031361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 147/314] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:48 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:49.474289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cf82954a-a38b-4063-ab6f-a82ac820e59a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:49.474887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cf82954a-a38b-4063-ab6f-a82ac820e59a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:49.481974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf82954a-a38b-4063-ab6f-a82ac820e59a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:49.482705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf82954a-a38b-4063-ab6f-a82ac820e59a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:49.483830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf82954a-a38b-4063-ab6f-a82ac820e59a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:49.484291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf82954a-a38b-4063-ab6f-a82ac820e59a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:49.648970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cf82954a-a38b-4063-ab6f-a82ac820e59a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:49.657920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cf82954a-a38b-4063-ab6f-a82ac820e59a tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.187313 Feb 21 00:39:49.658497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 168/315] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:49 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:50.047434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7fe00cd7-80c1-4c82-b0cd-d3698f39a300 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:50.048049 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7fe00cd7-80c1-4c82-b0cd-d3698f39a300 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:50.054860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fe00cd7-80c1-4c82-b0cd-d3698f39a300 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:50.055513 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fe00cd7-80c1-4c82-b0cd-d3698f39a300 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:50.056346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fe00cd7-80c1-4c82-b0cd-d3698f39a300 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:50.056856 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fe00cd7-80c1-4c82-b0cd-d3698f39a300 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:50.211022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7fe00cd7-80c1-4c82-b0cd-d3698f39a300 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:50.220161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7fe00cd7-80c1-4c82-b0cd-d3698f39a300 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.176559 Feb 21 00:39:50.220791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 148/316] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:50 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:50.676212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce10437f-f8ae-433c-abb0-6346de24552e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:50.677006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce10437f-f8ae-433c-abb0-6346de24552e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:50.683121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce10437f-f8ae-433c-abb0-6346de24552e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:50.683682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce10437f-f8ae-433c-abb0-6346de24552e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:50.684608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce10437f-f8ae-433c-abb0-6346de24552e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:50.685134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce10437f-f8ae-433c-abb0-6346de24552e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:50.858491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce10437f-f8ae-433c-abb0-6346de24552e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:50.867374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce10437f-f8ae-433c-abb0-6346de24552e tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.194773 Feb 21 00:39:50.871145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 169/317] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:50 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:51.236841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-12d4c4b1-0ad1-44ff-a0d3-e759d3c498d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:51.238240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-12d4c4b1-0ad1-44ff-a0d3-e759d3c498d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:51.245472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12d4c4b1-0ad1-44ff-a0d3-e759d3c498d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:51.246032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12d4c4b1-0ad1-44ff-a0d3-e759d3c498d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:51.247383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12d4c4b1-0ad1-44ff-a0d3-e759d3c498d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:51.247911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12d4c4b1-0ad1-44ff-a0d3-e759d3c498d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:51.405714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-12d4c4b1-0ad1-44ff-a0d3-e759d3c498d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:51.419642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-12d4c4b1-0ad1-44ff-a0d3-e759d3c498d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.186050 Feb 21 00:39:51.429084 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 149/318] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:51.889077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8abdd597-2ee1-4e40-b65c-e480db88897d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:51.890046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8abdd597-2ee1-4e40-b65c-e480db88897d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:51.895761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8abdd597-2ee1-4e40-b65c-e480db88897d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:51.896230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8abdd597-2ee1-4e40-b65c-e480db88897d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:51.897073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8abdd597-2ee1-4e40-b65c-e480db88897d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:51.897538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8abdd597-2ee1-4e40-b65c-e480db88897d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:52.067696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8abdd597-2ee1-4e40-b65c-e480db88897d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:52.077340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8abdd597-2ee1-4e40-b65c-e480db88897d tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1521 microversion: 2.1 time: 0.192724 Feb 21 00:39:52.086852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 170/319] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:51 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:52.436606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c22f52b3-42d1-407d-b3ff-f2da84e2f35a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:52.438184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c22f52b3-42d1-407d-b3ff-f2da84e2f35a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:52.445545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c22f52b3-42d1-407d-b3ff-f2da84e2f35a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:52.446461 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c22f52b3-42d1-407d-b3ff-f2da84e2f35a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:52.447388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c22f52b3-42d1-407d-b3ff-f2da84e2f35a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:52.448326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c22f52b3-42d1-407d-b3ff-f2da84e2f35a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:52.615871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-45fd8a6a-0b60-40bb-967e-a6138ab59dae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Action: 'create', calling method: .version_select at 0x7fe56cd32280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-508035979"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:52.634697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-45fd8a6a-0b60-40bb-967e-a6138ab59dae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Getting quotas for project 5b7eecd8ed19485e9351a92ac0268585. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:39:52.642336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-45fd8a6a-0b60-40bb-967e-a6138ab59dae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Getting quotas for user e90616794a754083833c374f52ce1227 and project 5b7eecd8ed19485e9351a92ac0268585. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:39:52.973514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c22f52b3-42d1-407d-b3ff-f2da84e2f35a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:52.977011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-45fd8a6a-0b60-40bb-967e-a6138ab59dae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Getting quotas for project 5b7eecd8ed19485e9351a92ac0268585. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:39:52.981239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-45fd8a6a-0b60-40bb-967e-a6138ab59dae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Getting quotas for user e90616794a754083833c374f52ce1227 and project 5b7eecd8ed19485e9351a92ac0268585. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:39:52.985517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c22f52b3-42d1-407d-b3ff-f2da84e2f35a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.553217 Feb 21 00:39:52.996248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 150/320] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:52.996892 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-45fd8a6a-0b60-40bb-967e-a6138ab59dae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.385303 Feb 21 00:39:52.997570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 171/321] 10.222.0.72 () {60 vars in 1157 bytes} [Mon Feb 21 00:39:52 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:39:53.004311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-584f6755-f0bc-4451-9747-8856fe5ca85e req-797f295c-0283-4d67-b966-e490af049c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bedd6d6-814a-48db-a1ca-b35b01e44759", "name": "network-vif-deleted", "tag": "7d5e4a15-788e-4ca8-ab9b-4b2d972b4aa0"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:53.006141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:39:53.006141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:39:53.013888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-584f6755-f0bc-4451-9747-8856fe5ca85e req-797f295c-0283-4d67-b966-e490af049c10 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:53.014552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-584f6755-f0bc-4451-9747-8856fe5ca85e req-797f295c-0283-4d67-b966-e490af049c10 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:53.028783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-584f6755-f0bc-4451-9747-8856fe5ca85e req-797f295c-0283-4d67-b966-e490af049c10 service nova] Creating event network-vif-deleted:7d5e4a15-788e-4ca8-ab9b-4b2d972b4aa0 for instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 on hv-cinder-81322 Feb 21 00:39:53.034654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-584f6755-f0bc-4451-9747-8856fe5ca85e req-797f295c-0283-4d67-b966-e490af049c10 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036768 Feb 21 00:39:53.035977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 151/322] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:39:53.049600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1177110514", "imageRef": "dab0b014-59e5-4e5b-bdf5-ca8c423d5081", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-508035979", "networks": [{"uuid": "f1f7a656-f72b-45a5-8404-d2233f1ae41d"}]}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:53.094655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:53.095841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:53.102910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:53.103564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:53.104362 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:53.104879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:53.111330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] validate_networks() for [('f1f7a656-f72b-45a5-8404-d2233f1ae41d', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:39:53.135370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:53.135813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:53.136265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lazy-loading 'fault' on Instance uuid 2bedd6d6-814a-48db-a1ca-b35b01e44759 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:39:53.182266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bad9e824c94386b78c96dcceb23e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520a17e70e484b2a89470f10c4b29c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:53.190157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ba57ee3e-725a-4cb6-8430-a3dfcc45cd90 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 200 len: 1311 microversion: 2.1 time: 0.099490 Feb 21 00:39:53.190660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 152/323] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:53 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:39:53.890156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:39:53.890572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:39:53.891036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:39:53.891634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:39:53.892041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:39:53.901284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:53.901735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:53.902667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:53.903095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:53.919459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Getting quotas for project 5b7eecd8ed19485e9351a92ac0268585. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:39:53.923657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Getting quotas for user e90616794a754083833c374f52ce1227 and project 5b7eecd8ed19485e9351a92ac0268585. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:39:53.934917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:39:53.937249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dab0b014-59e5-4e5b-bdf5-ca8c423d5081',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:39:53.989398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [6e2cc5d3-6aed-4fff-93a0-50bd30980305] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 00:39:54.002224 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-efbd6cd5-3d6d-4355-8574-2408144483e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:54.002910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-efbd6cd5-3d6d-4355-8574-2408144483e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:54.009176 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-efbd6cd5-3d6d-4355-8574-2408144483e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:54.009614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-efbd6cd5-3d6d-4355-8574-2408144483e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:54.010385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-efbd6cd5-3d6d-4355-8574-2408144483e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:54.010807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-efbd6cd5-3d6d-4355-8574-2408144483e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:54.165691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-efbd6cd5-3d6d-4355-8574-2408144483e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:54.169984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-efbd6cd5-3d6d-4355-8574-2408144483e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.171389 Feb 21 00:39:54.170924 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 153/324] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:53 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:39:54.207782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:54.207883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] [instance: 2bedd6d6-814a-48db-a1ca-b35b01e44759] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:54.213873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:54.214397 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:54.215372 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:54.215857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:54.230625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] HTTP exception thrown: Instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 could not be found. Feb 21 00:39:54.231335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] Returning 404 to user: Instance 2bedd6d6-814a-48db-a1ca-b35b01e44759 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:39:54.232245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-996bb203-3f0f-4665-a240-70211b240aa1 tempest-ServerRescueNegativeTestJSON-1736346812 tempest-ServerRescueNegativeTestJSON-1736346812-project] 10.222.0.72 "GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759" status: 404 len: 111 microversion: 2.1 time: 0.029170 Feb 21 00:39:54.232897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 154/325] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:54 2022] GET /compute/v2.1/servers/2bedd6d6-814a-48db-a1ca-b35b01e44759 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 00:39:54.999249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [6e2cc5d3-6aed-4fff-93a0-50bd30980305] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 60524. Feb 21 00:39:55.004642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6fcb56fa-a61f-4997-9ff3-7d620b139142 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958695 Feb 21 00:39:55.005551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 172/326] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:39:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 00:39:55.016799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-72888dfb-8546-4dbb-aa73-9888d1fc5125 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:55.018242 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-72888dfb-8546-4dbb-aa73-9888d1fc5125 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:55.078352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-72888dfb-8546-4dbb-aa73-9888d1fc5125 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:55.087271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-72888dfb-8546-4dbb-aa73-9888d1fc5125 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1258 microversion: 2.1 time: 0.075353 Feb 21 00:39:55.091625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 155/327] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:55 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:55.186507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c82ae969-7ef8-48ef-b655-3ffad3dedd83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:55.187113 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c82ae969-7ef8-48ef-b655-3ffad3dedd83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:55.196108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c82ae969-7ef8-48ef-b655-3ffad3dedd83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:55.196581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c82ae969-7ef8-48ef-b655-3ffad3dedd83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:55.197365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c82ae969-7ef8-48ef-b655-3ffad3dedd83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:55.197788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c82ae969-7ef8-48ef-b655-3ffad3dedd83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:55.449565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c82ae969-7ef8-48ef-b655-3ffad3dedd83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:55.458161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c82ae969-7ef8-48ef-b655-3ffad3dedd83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.275000 Feb 21 00:39:55.458819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 173/328] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:56.107127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-59610c55-13e4-45e1-a2a2-cd1603913da8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:56.108549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-59610c55-13e4-45e1-a2a2-cd1603913da8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:56.206938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-59610c55-13e4-45e1-a2a2-cd1603913da8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:56.215033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-59610c55-13e4-45e1-a2a2-cd1603913da8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1258 microversion: 2.1 time: 0.111781 Feb 21 00:39:56.215614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 156/329] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:56 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1258 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:56.474659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-611e9675-c6dc-466e-9983-166448168406 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:56.476170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-611e9675-c6dc-466e-9983-166448168406 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:56.483568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-611e9675-c6dc-466e-9983-166448168406 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:56.484347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-611e9675-c6dc-466e-9983-166448168406 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:56.485301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-611e9675-c6dc-466e-9983-166448168406 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:56.485882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-611e9675-c6dc-466e-9983-166448168406 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:56.700912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-611e9675-c6dc-466e-9983-166448168406 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:56.719401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-611e9675-c6dc-466e-9983-166448168406 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.247756 Feb 21 00:39:56.729569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 174/330] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:57.233655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ef588acd-0f19-4570-8884-7eabce985d7a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:57.234153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ef588acd-0f19-4570-8884-7eabce985d7a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:57.295402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ef588acd-0f19-4570-8884-7eabce985d7a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:57.302326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ef588acd-0f19-4570-8884-7eabce985d7a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1258 microversion: 2.1 time: 0.072583 Feb 21 00:39:57.303295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 157/331] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:57 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:57.737911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-24e3a882-17ee-4520-b411-4f93804bc6f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:57.738680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-24e3a882-17ee-4520-b411-4f93804bc6f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:57.745457 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24e3a882-17ee-4520-b411-4f93804bc6f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:57.749438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24e3a882-17ee-4520-b411-4f93804bc6f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:57.750360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24e3a882-17ee-4520-b411-4f93804bc6f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:57.750809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24e3a882-17ee-4520-b411-4f93804bc6f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:57.896289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-24e3a882-17ee-4520-b411-4f93804bc6f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:57.903713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-24e3a882-17ee-4520-b411-4f93804bc6f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.169780 Feb 21 00:39:57.904291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 175/332] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:58.319868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b73473ee-8616-41b0-884b-01dcb4cc327e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:58.321071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b73473ee-8616-41b0-884b-01dcb4cc327e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:58.327761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b73473ee-8616-41b0-884b-01dcb4cc327e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:58.328270 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b73473ee-8616-41b0-884b-01dcb4cc327e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:58.329092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b73473ee-8616-41b0-884b-01dcb4cc327e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:58.329513 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b73473ee-8616-41b0-884b-01dcb4cc327e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:58.413363 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b73473ee-8616-41b0-884b-01dcb4cc327e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:58.431906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b73473ee-8616-41b0-884b-01dcb4cc327e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1316 microversion: 2.1 time: 0.113949 Feb 21 00:39:58.440070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 158/333] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:58 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:58.629090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-bf4d0e36-f75f-4c0b-b95d-5b25404daf29 req-420d9535-3c89-4792-9a1d-58c83ed66af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d201f02-8582-4720-942e-8d62400e176f", "name": "network-vif-plugged", "status": "completed", "tag": "bf929627-3fbe-4a88-9f95-bbe9870fa556"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:39:58.631172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:39:58.631172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:39:58.642285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-bf4d0e36-f75f-4c0b-b95d-5b25404daf29 req-420d9535-3c89-4792-9a1d-58c83ed66af6 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:58.643051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-bf4d0e36-f75f-4c0b-b95d-5b25404daf29 req-420d9535-3c89-4792-9a1d-58c83ed66af6 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:58.658110 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-bf4d0e36-f75f-4c0b-b95d-5b25404daf29 req-420d9535-3c89-4792-9a1d-58c83ed66af6 service nova] Creating event network-vif-plugged:bf929627-3fbe-4a88-9f95-bbe9870fa556 for instance 9d201f02-8582-4720-942e-8d62400e176f on hv-cinder-81322 Feb 21 00:39:58.673275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-bf4d0e36-f75f-4c0b-b95d-5b25404daf29 req-420d9535-3c89-4792-9a1d-58c83ed66af6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048032 Feb 21 00:39:58.674524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 176/334] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:39:58.929439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3da1c026-c919-4e9d-add5-b76b1ed04338 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:58.931611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3da1c026-c919-4e9d-add5-b76b1ed04338 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:58.949605 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3da1c026-c919-4e9d-add5-b76b1ed04338 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:58.950362 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3da1c026-c919-4e9d-add5-b76b1ed04338 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:58.953219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3da1c026-c919-4e9d-add5-b76b1ed04338 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:58.955336 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3da1c026-c919-4e9d-add5-b76b1ed04338 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:59.193912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3da1c026-c919-4e9d-add5-b76b1ed04338 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:59.202990 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3da1c026-c919-4e9d-add5-b76b1ed04338 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.285942 Feb 21 00:39:59.211370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 159/335] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:58 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:39:59.458043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9a8b2686-92bb-4c09-b3b8-eeccdd8bbad7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:39:59.458871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9a8b2686-92bb-4c09-b3b8-eeccdd8bbad7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:39:59.469199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a8b2686-92bb-4c09-b3b8-eeccdd8bbad7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:59.470398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a8b2686-92bb-4c09-b3b8-eeccdd8bbad7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:59.487224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a8b2686-92bb-4c09-b3b8-eeccdd8bbad7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:39:59.487599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a8b2686-92bb-4c09-b3b8-eeccdd8bbad7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:39:59.810984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9a8b2686-92bb-4c09-b3b8-eeccdd8bbad7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:39:59.830909 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9a8b2686-92bb-4c09-b3b8-eeccdd8bbad7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.377915 Feb 21 00:39:59.837649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 177/336] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:39:59 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:00.234159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-59b028c9-3529-4e20-8e67-c06f5f2ab801 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:00.234159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-59b028c9-3529-4e20-8e67-c06f5f2ab801 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:00.239304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59b028c9-3529-4e20-8e67-c06f5f2ab801 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:00.239753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59b028c9-3529-4e20-8e67-c06f5f2ab801 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:00.240586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59b028c9-3529-4e20-8e67-c06f5f2ab801 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:00.241019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59b028c9-3529-4e20-8e67-c06f5f2ab801 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:00.436192 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-59b028c9-3529-4e20-8e67-c06f5f2ab801 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:00.445302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-59b028c9-3529-4e20-8e67-c06f5f2ab801 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.220054 Feb 21 00:40:00.445888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 160/337] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:00.848517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0d8ef663-d925-4b85-939e-cc75126bc583 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:00.849215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0d8ef663-d925-4b85-939e-cc75126bc583 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:00.855898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d8ef663-d925-4b85-939e-cc75126bc583 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:00.856622 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d8ef663-d925-4b85-939e-cc75126bc583 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:00.857617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d8ef663-d925-4b85-939e-cc75126bc583 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:00.858178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d8ef663-d925-4b85-939e-cc75126bc583 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:01.027165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0d8ef663-d925-4b85-939e-cc75126bc583 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:01.041932 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0d8ef663-d925-4b85-939e-cc75126bc583 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.198119 Feb 21 00:40:01.051747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 178/338] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:00 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:01.462333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c383eb2d-1b38-4aa0-bfa7-7eafb70706dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:01.463533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c383eb2d-1b38-4aa0-bfa7-7eafb70706dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:01.470446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c383eb2d-1b38-4aa0-bfa7-7eafb70706dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:01.471110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c383eb2d-1b38-4aa0-bfa7-7eafb70706dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:01.472077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c383eb2d-1b38-4aa0-bfa7-7eafb70706dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:01.472527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c383eb2d-1b38-4aa0-bfa7-7eafb70706dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:01.736044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c383eb2d-1b38-4aa0-bfa7-7eafb70706dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:01.747697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c383eb2d-1b38-4aa0-bfa7-7eafb70706dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.285020 Feb 21 00:40:01.750377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 161/339] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:01 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:02.058904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-16ae6216-e580-4526-837b-4bd11265e156 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:02.059507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-16ae6216-e580-4526-837b-4bd11265e156 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:02.069280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16ae6216-e580-4526-837b-4bd11265e156 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:02.069800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16ae6216-e580-4526-837b-4bd11265e156 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:02.103928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16ae6216-e580-4526-837b-4bd11265e156 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:02.106915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16ae6216-e580-4526-837b-4bd11265e156 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:02.267170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-16ae6216-e580-4526-837b-4bd11265e156 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:02.275730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-16ae6216-e580-4526-837b-4bd11265e156 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.220496 Feb 21 00:40:02.280480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 179/340] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:02 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:02.766122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d15bb1d1-a7c5-42f9-b92f-aee1eef1bcc6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:02.766872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d15bb1d1-a7c5-42f9-b92f-aee1eef1bcc6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:02.777987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d15bb1d1-a7c5-42f9-b92f-aee1eef1bcc6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:02.778514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d15bb1d1-a7c5-42f9-b92f-aee1eef1bcc6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:02.779311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d15bb1d1-a7c5-42f9-b92f-aee1eef1bcc6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:02.779748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d15bb1d1-a7c5-42f9-b92f-aee1eef1bcc6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:02.892709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-984504936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1495553514", "security_groups": [{"name": "tempest-secgroup-smoke-331155839"}], "block_device_mapping_v2": [{"uuid": "3b95d523-e6aa-46bc-9fd0-8510c6219636", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d18a1c2-aa2f-433e-b403-44570eba9fc3"}]}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:03.046803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] validate_networks() for [('7d18a1c2-aa2f-433e-b403-44570eba9fc3', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:40:03.062612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d15bb1d1-a7c5-42f9-b92f-aee1eef1bcc6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:03.070358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d15bb1d1-a7c5-42f9-b92f-aee1eef1bcc6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.308036 Feb 21 00:40:03.070932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 162/341] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:03.299299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-37a71236-ed71-4a9c-8983-592f742aa332 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:03.300233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-37a71236-ed71-4a9c-8983-592f742aa332 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:03.309067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-37a71236-ed71-4a9c-8983-592f742aa332 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:03.309914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-37a71236-ed71-4a9c-8983-592f742aa332 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:03.311156 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-37a71236-ed71-4a9c-8983-592f742aa332 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:03.311879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-37a71236-ed71-4a9c-8983-592f742aa332 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:03.491109 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-37a71236-ed71-4a9c-8983-592f742aa332 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:03.504521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-37a71236-ed71-4a9c-8983-592f742aa332 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.210967 Feb 21 00:40:03.505760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 163/342] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:03 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:03.531451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:40:03.532740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:40:03.533359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:40:03.534104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:40:03.534855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:40:03.545172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:03.545950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:03.547164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:03.552952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:03.570667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Getting quotas for project 7d143cea723743ada5bdde1be0b26db4. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:40:03.574846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Getting quotas for user 01450ffdb03d4d51b6c96024085b1cf5 and project 7d143cea723743ada5bdde1be0b26db4. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:40:03.649137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:40:03.651251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b95d523-e6aa-46bc-9fd0-8510c6219636',volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:40:03.840841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ca24636d-1e4b-4194-8b58-a2da665dcfb0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.951899 Feb 21 00:40:03.847320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 180/343] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:40:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 00:40:03.856379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5ec1cf45-83c3-4339-b425-e4ca07b0fcf3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:03.857010 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5ec1cf45-83c3-4339-b425-e4ca07b0fcf3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:03.931996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5ec1cf45-83c3-4339-b425-e4ca07b0fcf3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:03.938565 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5ec1cf45-83c3-4339-b425-e4ca07b0fcf3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1094 microversion: 2.1 time: 0.086203 Feb 21 00:40:03.940107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 164/344] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:03 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:04.087206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5424384e-e2f9-4805-a958-c42f62a425a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:04.087815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5424384e-e2f9-4805-a958-c42f62a425a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:04.095123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5424384e-e2f9-4805-a958-c42f62a425a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:04.099979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5424384e-e2f9-4805-a958-c42f62a425a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:04.101254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5424384e-e2f9-4805-a958-c42f62a425a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:04.102500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5424384e-e2f9-4805-a958-c42f62a425a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:04.387683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5424384e-e2f9-4805-a958-c42f62a425a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:04.428153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5424384e-e2f9-4805-a958-c42f62a425a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.344419 Feb 21 00:40:04.428895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 181/345] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:04 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:04.521582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-73458454-dd64-49cb-ba23-3ea5d7b78409 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:04.522421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-73458454-dd64-49cb-ba23-3ea5d7b78409 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:04.529510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73458454-dd64-49cb-ba23-3ea5d7b78409 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:04.530519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73458454-dd64-49cb-ba23-3ea5d7b78409 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:04.531463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73458454-dd64-49cb-ba23-3ea5d7b78409 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:04.531897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73458454-dd64-49cb-ba23-3ea5d7b78409 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:04.759602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-73458454-dd64-49cb-ba23-3ea5d7b78409 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:04.768872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-73458454-dd64-49cb-ba23-3ea5d7b78409 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.250898 Feb 21 00:40:04.770127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 165/346] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:04 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:04.955192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5eb37468-4fdc-4fea-8739-5067a7b0d95d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:04.955802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5eb37468-4fdc-4fea-8739-5067a7b0d95d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:04.979621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5eb37468-4fdc-4fea-8739-5067a7b0d95d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:04.980068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5eb37468-4fdc-4fea-8739-5067a7b0d95d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:04.980910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5eb37468-4fdc-4fea-8739-5067a7b0d95d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:04.981320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5eb37468-4fdc-4fea-8739-5067a7b0d95d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:05.046356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5eb37468-4fdc-4fea-8739-5067a7b0d95d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:05.054768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5eb37468-4fdc-4fea-8739-5067a7b0d95d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1144 microversion: 2.1 time: 0.103346 Feb 21 00:40:05.055405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 182/347] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:04 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1144 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:05.444946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-742eb0f1-0b63-43de-84ec-b64d678c9279 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:05.446289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-742eb0f1-0b63-43de-84ec-b64d678c9279 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:05.455179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-742eb0f1-0b63-43de-84ec-b64d678c9279 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:05.456792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-742eb0f1-0b63-43de-84ec-b64d678c9279 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:05.457782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-742eb0f1-0b63-43de-84ec-b64d678c9279 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:05.459305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-742eb0f1-0b63-43de-84ec-b64d678c9279 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:05.660967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-742eb0f1-0b63-43de-84ec-b64d678c9279 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:05.668672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-742eb0f1-0b63-43de-84ec-b64d678c9279 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.227381 Feb 21 00:40:05.669231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 166/348] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:05 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:05.785789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3a6a2093-508c-49d7-aadc-1407653f8eda tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:05.786636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3a6a2093-508c-49d7-aadc-1407653f8eda tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:05.804769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3a6a2093-508c-49d7-aadc-1407653f8eda tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:05.805615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3a6a2093-508c-49d7-aadc-1407653f8eda tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:05.806528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3a6a2093-508c-49d7-aadc-1407653f8eda tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:05.807014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3a6a2093-508c-49d7-aadc-1407653f8eda tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:06.072102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-404cece7-177e-408c-a9d6-c2f6ceb0f1b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:06.073051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-404cece7-177e-408c-a9d6-c2f6ceb0f1b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:06.082854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-404cece7-177e-408c-a9d6-c2f6ceb0f1b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:06.083467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-404cece7-177e-408c-a9d6-c2f6ceb0f1b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:06.087739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-404cece7-177e-408c-a9d6-c2f6ceb0f1b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:06.088801 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-404cece7-177e-408c-a9d6-c2f6ceb0f1b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:06.147849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3a6a2093-508c-49d7-aadc-1407653f8eda tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:06.155824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3a6a2093-508c-49d7-aadc-1407653f8eda tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.374178 Feb 21 00:40:06.165072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 183/349] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:05 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:06.219392 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-404cece7-177e-408c-a9d6-c2f6ceb0f1b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:06.226667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-404cece7-177e-408c-a9d6-c2f6ceb0f1b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1144 microversion: 2.1 time: 0.159423 Feb 21 00:40:06.227239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 167/350] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:06 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1144 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:06.694849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8f851c73-8495-4d8a-8cdc-c5b0253103ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:06.695665 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8f851c73-8495-4d8a-8cdc-c5b0253103ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:06.713837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f851c73-8495-4d8a-8cdc-c5b0253103ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:06.714822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f851c73-8495-4d8a-8cdc-c5b0253103ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:06.715806 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f851c73-8495-4d8a-8cdc-c5b0253103ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:06.720840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f851c73-8495-4d8a-8cdc-c5b0253103ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:07.030903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8f851c73-8495-4d8a-8cdc-c5b0253103ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:07.045498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8f851c73-8495-4d8a-8cdc-c5b0253103ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.354253 Feb 21 00:40:07.045498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 184/351] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:06 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:07.173985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-df994a62-fdc8-4a43-88fd-58208022dbc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:07.175209 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-df994a62-fdc8-4a43-88fd-58208022dbc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:07.181364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df994a62-fdc8-4a43-88fd-58208022dbc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:07.182081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df994a62-fdc8-4a43-88fd-58208022dbc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:07.183338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df994a62-fdc8-4a43-88fd-58208022dbc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:07.183767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df994a62-fdc8-4a43-88fd-58208022dbc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:07.243200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-25119e75-2b79-4792-9e89-d90deeee77e5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:07.243772 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-25119e75-2b79-4792-9e89-d90deeee77e5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:07.256700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-25119e75-2b79-4792-9e89-d90deeee77e5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:07.257129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-25119e75-2b79-4792-9e89-d90deeee77e5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:07.260721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-25119e75-2b79-4792-9e89-d90deeee77e5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:07.261287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-25119e75-2b79-4792-9e89-d90deeee77e5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:07.343444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-25119e75-2b79-4792-9e89-d90deeee77e5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:07.352074 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-25119e75-2b79-4792-9e89-d90deeee77e5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1144 microversion: 2.1 time: 0.112804 Feb 21 00:40:07.363998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 185/352] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:07 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1144 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:07.464897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-df994a62-fdc8-4a43-88fd-58208022dbc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:07.475538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-df994a62-fdc8-4a43-88fd-58208022dbc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.304992 Feb 21 00:40:07.480889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 168/353] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:07 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:08.068146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8237c44b-b500-4e0e-b9a2-d1294e53f60f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:08.069300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8237c44b-b500-4e0e-b9a2-d1294e53f60f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:08.077562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8237c44b-b500-4e0e-b9a2-d1294e53f60f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:08.078202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8237c44b-b500-4e0e-b9a2-d1294e53f60f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:08.078992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8237c44b-b500-4e0e-b9a2-d1294e53f60f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:08.079420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8237c44b-b500-4e0e-b9a2-d1294e53f60f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:08.258511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8237c44b-b500-4e0e-b9a2-d1294e53f60f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:08.266343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8237c44b-b500-4e0e-b9a2-d1294e53f60f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.202398 Feb 21 00:40:08.267214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 186/354] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:08 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:08.370805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bc46159d-c09c-409e-aa81-9f2d07b1d961 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:08.371464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bc46159d-c09c-409e-aa81-9f2d07b1d961 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:08.380729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bc46159d-c09c-409e-aa81-9f2d07b1d961 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:08.389260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bc46159d-c09c-409e-aa81-9f2d07b1d961 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:08.390490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bc46159d-c09c-409e-aa81-9f2d07b1d961 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:08.391148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bc46159d-c09c-409e-aa81-9f2d07b1d961 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:08.488960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bc46159d-c09c-409e-aa81-9f2d07b1d961 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:08.495833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-34651c25-35cc-4383-8eff-075839888c37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:08.496903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-34651c25-35cc-4383-8eff-075839888c37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:08.506307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34651c25-35cc-4383-8eff-075839888c37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:08.508361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34651c25-35cc-4383-8eff-075839888c37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:08.509454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34651c25-35cc-4383-8eff-075839888c37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:08.509915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34651c25-35cc-4383-8eff-075839888c37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:08.518213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bc46159d-c09c-409e-aa81-9f2d07b1d961 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1144 microversion: 2.1 time: 0.150833 Feb 21 00:40:08.519048 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 169/355] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:08 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1144 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:08.756999 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-34651c25-35cc-4383-8eff-075839888c37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:08.766050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-34651c25-35cc-4383-8eff-075839888c37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.274233 Feb 21 00:40:08.766795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 187/356] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:08 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:09.000750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8ccd2572-8696-432e-8e10-2a4bd5644c70 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bdfc425-3634-403f-82cf-5ec28d270475"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:09.002018 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8ccd2572-8696-432e-8e10-2a4bd5644c70 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:09.015353 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ccd2572-8696-432e-8e10-2a4bd5644c70 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:09.015797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ccd2572-8696-432e-8e10-2a4bd5644c70 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:09.016625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ccd2572-8696-432e-8e10-2a4bd5644c70 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:09.017056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ccd2572-8696-432e-8e10-2a4bd5644c70 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:09.283540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7c4caa4f-9068-434c-96b8-9055663ab01a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:09.284224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7c4caa4f-9068-434c-96b8-9055663ab01a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:09.290471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c4caa4f-9068-434c-96b8-9055663ab01a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:09.290908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c4caa4f-9068-434c-96b8-9055663ab01a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:09.291909 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c4caa4f-9068-434c-96b8-9055663ab01a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:09.292521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c4caa4f-9068-434c-96b8-9055663ab01a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:09.433227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7c4caa4f-9068-434c-96b8-9055663ab01a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:09.441425 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7c4caa4f-9068-434c-96b8-9055663ab01a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.162065 Feb 21 00:40:09.442060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 188/357] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:09 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:09.534781 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-27137eef-07f6-44d6-87f2-084ce898d93f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:09.536011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-27137eef-07f6-44d6-87f2-084ce898d93f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:09.541982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27137eef-07f6-44d6-87f2-084ce898d93f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:09.542498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27137eef-07f6-44d6-87f2-084ce898d93f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:09.543339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27137eef-07f6-44d6-87f2-084ce898d93f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:09.543767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27137eef-07f6-44d6-87f2-084ce898d93f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:09.602838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-27137eef-07f6-44d6-87f2-084ce898d93f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:09.612376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-27137eef-07f6-44d6-87f2-084ce898d93f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1144 microversion: 2.1 time: 0.081171 Feb 21 00:40:09.612993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 189/358] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:09 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:09.783624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a6979aec-672c-46e0-90d1-bd1b557bb3fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:09.784262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a6979aec-672c-46e0-90d1-bd1b557bb3fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:09.790759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a6979aec-672c-46e0-90d1-bd1b557bb3fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:09.791199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a6979aec-672c-46e0-90d1-bd1b557bb3fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:09.791962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a6979aec-672c-46e0-90d1-bd1b557bb3fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:09.792409 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a6979aec-672c-46e0-90d1-bd1b557bb3fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:09.925970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a6979aec-672c-46e0-90d1-bd1b557bb3fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:09.933267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a6979aec-672c-46e0-90d1-bd1b557bb3fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.153651 Feb 21 00:40:09.933935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 190/359] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:09 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:10.457984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b743ddcd-97c4-47b5-ab8e-594bdc59fbe9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:10.458592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b743ddcd-97c4-47b5-ab8e-594bdc59fbe9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:10.464564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b743ddcd-97c4-47b5-ab8e-594bdc59fbe9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:10.465005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b743ddcd-97c4-47b5-ab8e-594bdc59fbe9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:10.465767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b743ddcd-97c4-47b5-ab8e-594bdc59fbe9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:10.466192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b743ddcd-97c4-47b5-ab8e-594bdc59fbe9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:10.601179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b743ddcd-97c4-47b5-ab8e-594bdc59fbe9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:10.608449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b743ddcd-97c4-47b5-ab8e-594bdc59fbe9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.154077 Feb 21 00:40:10.609016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 191/360] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:10 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:10.628488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-052a45ed-9f0c-43c4-9b4e-9095c7f1a5e1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:10.629096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-052a45ed-9f0c-43c4-9b4e-9095c7f1a5e1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:10.634997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-052a45ed-9f0c-43c4-9b4e-9095c7f1a5e1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:10.635434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-052a45ed-9f0c-43c4-9b4e-9095c7f1a5e1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:10.636323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-052a45ed-9f0c-43c4-9b4e-9095c7f1a5e1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:10.636790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-052a45ed-9f0c-43c4-9b4e-9095c7f1a5e1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:10.697840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-052a45ed-9f0c-43c4-9b4e-9095c7f1a5e1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:10.705717 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-052a45ed-9f0c-43c4-9b4e-9095c7f1a5e1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1144 microversion: 2.1 time: 0.080667 Feb 21 00:40:10.706360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 192/361] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:10 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:10.949984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f7f57ff6-dd78-45e7-b6d3-8a3eafa5b680 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:10.950653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f7f57ff6-dd78-45e7-b6d3-8a3eafa5b680 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:10.957134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f7f57ff6-dd78-45e7-b6d3-8a3eafa5b680 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:10.957504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f7f57ff6-dd78-45e7-b6d3-8a3eafa5b680 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:10.958270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f7f57ff6-dd78-45e7-b6d3-8a3eafa5b680 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:10.958690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f7f57ff6-dd78-45e7-b6d3-8a3eafa5b680 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:11.093621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f7f57ff6-dd78-45e7-b6d3-8a3eafa5b680 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:11.101353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f7f57ff6-dd78-45e7-b6d3-8a3eafa5b680 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.155108 Feb 21 00:40:11.101940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 193/362] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:10 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:11.628881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7d3a94a2-ae5a-4065-a5fa-49ad07da1aa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:11.629827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7d3a94a2-ae5a-4065-a5fa-49ad07da1aa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:11.639680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d3a94a2-ae5a-4065-a5fa-49ad07da1aa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:11.640189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d3a94a2-ae5a-4065-a5fa-49ad07da1aa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:11.641015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d3a94a2-ae5a-4065-a5fa-49ad07da1aa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:11.641404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d3a94a2-ae5a-4065-a5fa-49ad07da1aa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:11.790778 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7d3a94a2-ae5a-4065-a5fa-49ad07da1aa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:11.802029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7d3a94a2-ae5a-4065-a5fa-49ad07da1aa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.178950 Feb 21 00:40:11.802715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 194/363] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:11 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:11.806810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a8558d8f-7de3-48e5-a47d-b131e074dcce tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:11.807390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a8558d8f-7de3-48e5-a47d-b131e074dcce tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:11.812884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a8558d8f-7de3-48e5-a47d-b131e074dcce tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:11.813322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a8558d8f-7de3-48e5-a47d-b131e074dcce tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:11.814085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a8558d8f-7de3-48e5-a47d-b131e074dcce tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:11.814511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a8558d8f-7de3-48e5-a47d-b131e074dcce tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:11.871123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a8558d8f-7de3-48e5-a47d-b131e074dcce tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:11.878300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a8558d8f-7de3-48e5-a47d-b131e074dcce tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1144 microversion: 2.1 time: 0.074660 Feb 21 00:40:11.878867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 195/364] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:11 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1144 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:12.118277 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7ad761f7-3b41-42e1-aafa-e892f3477fdf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:12.118771 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7ad761f7-3b41-42e1-aafa-e892f3477fdf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:12.125308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7ad761f7-3b41-42e1-aafa-e892f3477fdf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:12.125758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7ad761f7-3b41-42e1-aafa-e892f3477fdf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:12.126519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7ad761f7-3b41-42e1-aafa-e892f3477fdf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:12.126941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7ad761f7-3b41-42e1-aafa-e892f3477fdf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:12.270101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7ad761f7-3b41-42e1-aafa-e892f3477fdf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:12.277505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7ad761f7-3b41-42e1-aafa-e892f3477fdf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.163000 Feb 21 00:40:12.278099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 196/365] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:12 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:12.822548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d014f901-8ec4-4931-998d-f6508eecd402 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:12.823782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d014f901-8ec4-4931-998d-f6508eecd402 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:12.833988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d014f901-8ec4-4931-998d-f6508eecd402 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:12.834710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d014f901-8ec4-4931-998d-f6508eecd402 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:12.836012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d014f901-8ec4-4931-998d-f6508eecd402 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:12.836741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d014f901-8ec4-4931-998d-f6508eecd402 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:12.976260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d014f901-8ec4-4931-998d-f6508eecd402 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:12.985144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d014f901-8ec4-4931-998d-f6508eecd402 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.168695 Feb 21 00:40:12.994373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 197/366] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:12 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:12.994373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-006a1bc6-3f20-4c10-815f-376eee06c9bc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:12.994373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-006a1bc6-3f20-4c10-815f-376eee06c9bc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:12.996640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-006a1bc6-3f20-4c10-815f-376eee06c9bc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:12.997101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-006a1bc6-3f20-4c10-815f-376eee06c9bc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:12.997886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-006a1bc6-3f20-4c10-815f-376eee06c9bc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:12.998310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-006a1bc6-3f20-4c10-815f-376eee06c9bc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:13.056913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-006a1bc6-3f20-4c10-815f-376eee06c9bc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:13.064315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-006a1bc6-3f20-4c10-815f-376eee06c9bc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1144 microversion: 2.1 time: 0.077260 Feb 21 00:40:13.064906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 198/367] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:12 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1144 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:13.294149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-78f92c13-59a7-48e9-8aa5-da9c820864a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:13.294853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-78f92c13-59a7-48e9-8aa5-da9c820864a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:13.301457 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78f92c13-59a7-48e9-8aa5-da9c820864a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:13.301956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78f92c13-59a7-48e9-8aa5-da9c820864a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:13.302835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78f92c13-59a7-48e9-8aa5-da9c820864a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:13.303293 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78f92c13-59a7-48e9-8aa5-da9c820864a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:13.443944 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-78f92c13-59a7-48e9-8aa5-da9c820864a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:13.451312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-78f92c13-59a7-48e9-8aa5-da9c820864a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.160795 Feb 21 00:40:13.451897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 199/368] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:13 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:13.456152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b5a0db38-bdf4-45b9-92b2-004f4c38e676 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:13.456689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b5a0db38-bdf4-45b9-92b2-004f4c38e676 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:13.462520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5a0db38-bdf4-45b9-92b2-004f4c38e676 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:13.462956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5a0db38-bdf4-45b9-92b2-004f4c38e676 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:13.463718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5a0db38-bdf4-45b9-92b2-004f4c38e676 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:13.464141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5a0db38-bdf4-45b9-92b2-004f4c38e676 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:13.487291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-b5a0db38-bdf4-45b9-92b2-004f4c38e676 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lazy-loading 'flavor' on Instance uuid f5aa3b9a-864e-42ff-81ec-278e00ddd8be {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:40:13.744510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b5a0db38-bdf4-45b9-92b2-004f4c38e676 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "POST /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/action" status: 202 len: 0 microversion: 2.20 time: 0.291365 Feb 21 00:40:13.748470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 200/369] 10.222.0.72 () {62 vars in 1318 bytes} [Mon Feb 21 00:40:13 2022] POST /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:40:13.756279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:13.757049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:13.767819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:13.768272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:13.769103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:13.770998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:13.881062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8ccd2572-8696-432e-8e10-2a4bd5644c70 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.884770 Feb 21 00:40:13.886854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 170/370] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 00:40:08 2022] POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 194 bytes in 4891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:13.949537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:13.957662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:13.959421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:13.960688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ef19bf9a-f74c-4a59-8096-a9c81cf7432f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.210732 Feb 21 00:40:13.964464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 201/371] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:14.003221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-88c0dcac-0e8b-4159-8a48-185b773fbb5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:14.004303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-88c0dcac-0e8b-4159-8a48-185b773fbb5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:14.010831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-88c0dcac-0e8b-4159-8a48-185b773fbb5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.011338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-88c0dcac-0e8b-4159-8a48-185b773fbb5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:14.012125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-88c0dcac-0e8b-4159-8a48-185b773fbb5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.012628 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-88c0dcac-0e8b-4159-8a48-185b773fbb5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:14.084120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-debcc3f0-7106-4c00-8be5-915d09566d85 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:14.084766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-debcc3f0-7106-4c00-8be5-915d09566d85 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:14.091740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-debcc3f0-7106-4c00-8be5-915d09566d85 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.093618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-debcc3f0-7106-4c00-8be5-915d09566d85 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:14.094432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-debcc3f0-7106-4c00-8be5-915d09566d85 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.095450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-debcc3f0-7106-4c00-8be5-915d09566d85 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:14.164247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-debcc3f0-7106-4c00-8be5-915d09566d85 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:14.173343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-debcc3f0-7106-4c00-8be5-915d09566d85 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1192 microversion: 2.1 time: 0.095790 Feb 21 00:40:14.174169 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 202/372] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:14 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:14.249797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-88c0dcac-0e8b-4159-8a48-185b773fbb5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:14.258410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-88c0dcac-0e8b-4159-8a48-185b773fbb5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1260 microversion: 2.1 time: 0.259958 Feb 21 00:40:14.263366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 171/373] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:14.346620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-0e737222-6bc0-4872-a1f9-0d248ea635f3 req-af64fe54-d09f-4954-a956-4d15f1e8c9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e018349-6a79-41ca-89e4-86d1bf355cd0", "tag": "01160744-2091-4d9b-9585-581bf4da5aa7"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:14.351819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:14.351819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:40:14.374993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0e737222-6bc0-4872-a1f9-0d248ea635f3 req-af64fe54-d09f-4954-a956-4d15f1e8c9b8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.375661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0e737222-6bc0-4872-a1f9-0d248ea635f3 req-af64fe54-d09f-4954-a956-4d15f1e8c9b8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:14.404369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-0e737222-6bc0-4872-a1f9-0d248ea635f3 req-af64fe54-d09f-4954-a956-4d15f1e8c9b8 service nova] Creating event network-changed:01160744-2091-4d9b-9585-581bf4da5aa7 for instance 1e018349-6a79-41ca-89e4-86d1bf355cd0 on hv-cinder-81322 Feb 21 00:40:14.410998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-0e737222-6bc0-4872-a1f9-0d248ea635f3 req-af64fe54-d09f-4954-a956-4d15f1e8c9b8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070250 Feb 21 00:40:14.412104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 203/374] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:14.467910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d38e9b8b-d73d-4186-9533-0abb3f30fb98 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:14.468978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d38e9b8b-d73d-4186-9533-0abb3f30fb98 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:14.481324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d38e9b8b-d73d-4186-9533-0abb3f30fb98 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.481999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d38e9b8b-d73d-4186-9533-0abb3f30fb98 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:14.483036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d38e9b8b-d73d-4186-9533-0abb3f30fb98 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.483615 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d38e9b8b-d73d-4186-9533-0abb3f30fb98 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:14.779387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d38e9b8b-d73d-4186-9533-0abb3f30fb98 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:14.787498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d38e9b8b-d73d-4186-9533-0abb3f30fb98 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.323343 Feb 21 00:40:14.788071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 172/375] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:14 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:14.983363 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:14.984974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:14.992109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.992755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:14.994384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:14.995148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:15.191543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dd22919b-0bec-4908-8f45-d64f38b3bed5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:15.192218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dd22919b-0bec-4908-8f45-d64f38b3bed5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:15.198614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dd22919b-0bec-4908-8f45-d64f38b3bed5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:15.199301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dd22919b-0bec-4908-8f45-d64f38b3bed5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:15.200123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dd22919b-0bec-4908-8f45-d64f38b3bed5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:15.200590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dd22919b-0bec-4908-8f45-d64f38b3bed5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:15.227190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:15.236692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:15.238606 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:15.240031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fb8086fc-f6a3-4598-9e99-bbe714525fbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.262611 Feb 21 00:40:15.241261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 204/376] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:15.275071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dd22919b-0bec-4908-8f45-d64f38b3bed5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:15.278897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4598f062-2944-4890-9e1d-d0171f3de2d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:15.279542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4598f062-2944-4890-9e1d-d0171f3de2d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:15.288999 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4598f062-2944-4890-9e1d-d0171f3de2d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:15.289437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4598f062-2944-4890-9e1d-d0171f3de2d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:15.290212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4598f062-2944-4890-9e1d-d0171f3de2d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:15.290623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4598f062-2944-4890-9e1d-d0171f3de2d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:15.295601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dd22919b-0bec-4908-8f45-d64f38b3bed5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1210 microversion: 2.1 time: 0.108442 Feb 21 00:40:15.296481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 173/377] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:15 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:15.562183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4598f062-2944-4890-9e1d-d0171f3de2d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:15.569955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4598f062-2944-4890-9e1d-d0171f3de2d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1444 microversion: 2.1 time: 0.298651 Feb 21 00:40:15.570689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 205/378] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1444 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:15.586612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8932979d-5eee-4c5b-ae0b-59727b526a0d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:15.587218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8932979d-5eee-4c5b-ae0b-59727b526a0d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:15.593290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8932979d-5eee-4c5b-ae0b-59727b526a0d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:15.593950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8932979d-5eee-4c5b-ae0b-59727b526a0d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:15.594752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8932979d-5eee-4c5b-ae0b-59727b526a0d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:15.595383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8932979d-5eee-4c5b-ae0b-59727b526a0d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:15.744046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8932979d-5eee-4c5b-ae0b-59727b526a0d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:15.757536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8932979d-5eee-4c5b-ae0b-59727b526a0d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1444 microversion: 2.1 time: 0.168848 Feb 21 00:40:15.758277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 174/379] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:15.803928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4cea4bc2-bf9b-4082-bc13-4c720962903b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:15.805032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4cea4bc2-bf9b-4082-bc13-4c720962903b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:15.811024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4cea4bc2-bf9b-4082-bc13-4c720962903b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:15.811695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4cea4bc2-bf9b-4082-bc13-4c720962903b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:15.812685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4cea4bc2-bf9b-4082-bc13-4c720962903b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:15.813295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4cea4bc2-bf9b-4082-bc13-4c720962903b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:16.070572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4cea4bc2-bf9b-4082-bc13-4c720962903b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:16.072384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4cea4bc2-bf9b-4082-bc13-4c720962903b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.271965 Feb 21 00:40:16.082207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 206/380] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:15 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:16.258110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:16.259530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:16.270120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:16.270827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:16.271863 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:16.272469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:16.314841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b594058f-209f-40e8-afea-5ac95eaf60fe tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:16.315827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b594058f-209f-40e8-afea-5ac95eaf60fe tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:16.327208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b594058f-209f-40e8-afea-5ac95eaf60fe tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:16.327824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b594058f-209f-40e8-afea-5ac95eaf60fe tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:16.329474 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b594058f-209f-40e8-afea-5ac95eaf60fe tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:16.330086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b594058f-209f-40e8-afea-5ac95eaf60fe tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:16.662827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:16.671443 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:16.673022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:16.674361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ef3107dc-aa89-4cca-a508-1fa3b4b3c23d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.420182 Feb 21 00:40:16.675274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 175/381] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:16.681461 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-baa6be11-9f22-4029-8b9c-34b8153eebc1 req-03a8e3aa-c1c0-4f8b-97c9-d82f9a1d75f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf1e55d-f089-4700-84ba-c7daee664ac5", "tag": "91e1b094-1b34-4120-8622-d4c4e422029c"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:16.683303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:16.683303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:40:16.691272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-baa6be11-9f22-4029-8b9c-34b8153eebc1 req-03a8e3aa-c1c0-4f8b-97c9-d82f9a1d75f3 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:16.692132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-baa6be11-9f22-4029-8b9c-34b8153eebc1 req-03a8e3aa-c1c0-4f8b-97c9-d82f9a1d75f3 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:16.697102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b594058f-209f-40e8-afea-5ac95eaf60fe tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:16.703493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-baa6be11-9f22-4029-8b9c-34b8153eebc1 req-03a8e3aa-c1c0-4f8b-97c9-d82f9a1d75f3 service nova] Creating event network-changed:91e1b094-1b34-4120-8622-d4c4e422029c for instance eaf1e55d-f089-4700-84ba-c7daee664ac5 on hv-cinder-81322 Feb 21 00:40:16.707963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b594058f-209f-40e8-afea-5ac95eaf60fe tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1277 microversion: 2.1 time: 0.397316 Feb 21 00:40:16.710077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-baa6be11-9f22-4029-8b9c-34b8153eebc1 req-03a8e3aa-c1c0-4f8b-97c9-d82f9a1d75f3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033233 Feb 21 00:40:16.711116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 176/382] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:16.716423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 207/383] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:16 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1277 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:17.090458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ad891675-c5cf-439b-a97d-2167c2cb6d89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:17.091224 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ad891675-c5cf-439b-a97d-2167c2cb6d89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:17.101326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ad891675-c5cf-439b-a97d-2167c2cb6d89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:17.101878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ad891675-c5cf-439b-a97d-2167c2cb6d89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:17.104859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ad891675-c5cf-439b-a97d-2167c2cb6d89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:17.105362 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ad891675-c5cf-439b-a97d-2167c2cb6d89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:17.381103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ad891675-c5cf-439b-a97d-2167c2cb6d89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:17.391831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ad891675-c5cf-439b-a97d-2167c2cb6d89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.306193 Feb 21 00:40:17.392782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 177/384] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:17 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:17.692274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:17.693617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:17.712113 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:17.712832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:17.714402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:17.714991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:17.726474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6328618c-0d80-412d-8da4-122546bea559 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:17.727082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6328618c-0d80-412d-8da4-122546bea559 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:17.734494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6328618c-0d80-412d-8da4-122546bea559 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:17.734938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6328618c-0d80-412d-8da4-122546bea559 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:17.741261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6328618c-0d80-412d-8da4-122546bea559 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:17.741701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6328618c-0d80-412d-8da4-122546bea559 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:17.955335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:17.964234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:17.965852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:17.967398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-18e8952b-494f-46ad-8649-97d3553c5442 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.279006 Feb 21 00:40:17.968055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 208/385] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:17 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:18.003805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6328618c-0d80-412d-8da4-122546bea559 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:18.011644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6328618c-0d80-412d-8da4-122546bea559 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1277 microversion: 2.1 time: 0.288764 Feb 21 00:40:18.012341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 178/386] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:17 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:18.335373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-a643bab7-31b9-4eaf-93ac-839365a5cb58 req-54c03bb5-5b33-495d-ad2f-fba057cec170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d201f02-8582-4720-942e-8d62400e176f", "tag": "bf929627-3fbe-4a88-9f95-bbe9870fa556"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:18.337274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:18.337274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:40:18.345019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-a643bab7-31b9-4eaf-93ac-839365a5cb58 req-54c03bb5-5b33-495d-ad2f-fba057cec170 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:18.345653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-a643bab7-31b9-4eaf-93ac-839365a5cb58 req-54c03bb5-5b33-495d-ad2f-fba057cec170 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:18.357399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-a643bab7-31b9-4eaf-93ac-839365a5cb58 req-54c03bb5-5b33-495d-ad2f-fba057cec170 service nova] Creating event network-changed:bf929627-3fbe-4a88-9f95-bbe9870fa556 for instance 9d201f02-8582-4720-942e-8d62400e176f on hv-cinder-81322 Feb 21 00:40:18.362520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-a643bab7-31b9-4eaf-93ac-839365a5cb58 req-54c03bb5-5b33-495d-ad2f-fba057cec170 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030920 Feb 21 00:40:18.363321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 209/387] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:40:18.408914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e3332796-0519-4948-bae6-37a037018d6e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:18.410763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e3332796-0519-4948-bae6-37a037018d6e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:18.430912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e3332796-0519-4948-bae6-37a037018d6e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:18.436219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e3332796-0519-4948-bae6-37a037018d6e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:18.438390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e3332796-0519-4948-bae6-37a037018d6e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:18.440009 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e3332796-0519-4948-bae6-37a037018d6e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:18.613823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e3332796-0519-4948-bae6-37a037018d6e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:18.622111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e3332796-0519-4948-bae6-37a037018d6e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.216883 Feb 21 00:40:18.632313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 179/388] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:18 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:18.986447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:18.987378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:18.995382 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:18.995826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:18.996657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:18.997068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:19.030801 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1ac24346-b450-4b40-b9d1-16b586dcbd93 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:19.032089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1ac24346-b450-4b40-b9d1-16b586dcbd93 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:19.040351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ac24346-b450-4b40-b9d1-16b586dcbd93 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:19.040906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ac24346-b450-4b40-b9d1-16b586dcbd93 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:19.042038 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ac24346-b450-4b40-b9d1-16b586dcbd93 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:19.042537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ac24346-b450-4b40-b9d1-16b586dcbd93 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:19.170226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:19.193584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:19.196152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:19.197881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d1d328bf-6322-4fb6-b722-834051211e07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.215849 Feb 21 00:40:19.199067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 210/389] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:19.216841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1ac24346-b450-4b40-b9d1-16b586dcbd93 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:19.225735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1ac24346-b450-4b40-b9d1-16b586dcbd93 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1277 microversion: 2.1 time: 0.201062 Feb 21 00:40:19.226828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 180/390] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:19 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:19.638965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3b49e2c4-5571-4eb0-98f7-77063d72f7b6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:19.639564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3b49e2c4-5571-4eb0-98f7-77063d72f7b6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:19.646384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3b49e2c4-5571-4eb0-98f7-77063d72f7b6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:19.646895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3b49e2c4-5571-4eb0-98f7-77063d72f7b6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:19.647922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3b49e2c4-5571-4eb0-98f7-77063d72f7b6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:19.648492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3b49e2c4-5571-4eb0-98f7-77063d72f7b6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:19.794154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3b49e2c4-5571-4eb0-98f7-77063d72f7b6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:19.805178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3b49e2c4-5571-4eb0-98f7-77063d72f7b6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.169884 Feb 21 00:40:19.806237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 211/391] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:19 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:20.216326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:20.217665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:20.226456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:20.227019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:20.228005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:20.228555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:20.244364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-23715052-4749-4202-8b59-609f99bfad60 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:20.244990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-23715052-4749-4202-8b59-609f99bfad60 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:20.251835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23715052-4749-4202-8b59-609f99bfad60 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:20.252279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23715052-4749-4202-8b59-609f99bfad60 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:20.253104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23715052-4749-4202-8b59-609f99bfad60 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:20.253543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23715052-4749-4202-8b59-609f99bfad60 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:20.381238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:20.388871 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:20.390351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:20.391499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4cee0cf2-8c8b-4eae-a86e-80e674be03ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.179134 Feb 21 00:40:20.392056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 181/392] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:20.396065 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-23715052-4749-4202-8b59-609f99bfad60 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:20.403393 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-23715052-4749-4202-8b59-609f99bfad60 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1277 microversion: 2.1 time: 0.164172 Feb 21 00:40:20.403944 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 212/393] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:20 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:20.826527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1571cf2e-c02d-41b2-aba1-4b4b30d7818c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:20.827368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1571cf2e-c02d-41b2-aba1-4b4b30d7818c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:20.837268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1571cf2e-c02d-41b2-aba1-4b4b30d7818c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:20.838033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1571cf2e-c02d-41b2-aba1-4b4b30d7818c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:20.839301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1571cf2e-c02d-41b2-aba1-4b4b30d7818c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:20.840021 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1571cf2e-c02d-41b2-aba1-4b4b30d7818c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:20.973632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1571cf2e-c02d-41b2-aba1-4b4b30d7818c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:20.981276 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1571cf2e-c02d-41b2-aba1-4b4b30d7818c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.161290 Feb 21 00:40:20.981849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 182/394] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:20 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:21.409239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:21.410148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:21.416321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:21.416794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:21.417541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:21.417994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:21.420651 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e1bd9d88-95ec-4f75-b98b-0ca789556ec9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:21.421455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e1bd9d88-95ec-4f75-b98b-0ca789556ec9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:21.428145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1bd9d88-95ec-4f75-b98b-0ca789556ec9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:21.428722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1bd9d88-95ec-4f75-b98b-0ca789556ec9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:21.429566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1bd9d88-95ec-4f75-b98b-0ca789556ec9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:21.430046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1bd9d88-95ec-4f75-b98b-0ca789556ec9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:21.558571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:21.566977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:21.569511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:21.570200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e1bd9d88-95ec-4f75-b98b-0ca789556ec9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:21.571457 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dee0e994-0c1f-402a-b392-6856f951d420 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.165836 Feb 21 00:40:21.572213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 213/395] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:21.576966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9536bf7c-fb7f-4e53-afc7-191c75c9cb75 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:21.579648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e1bd9d88-95ec-4f75-b98b-0ca789556ec9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.163017 Feb 21 00:40:21.580311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 183/396] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:21 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:21.582861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9536bf7c-fb7f-4e53-afc7-191c75c9cb75 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:21.583337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9536bf7c-fb7f-4e53-afc7-191c75c9cb75 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:21.640958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9536bf7c-fb7f-4e53-afc7-191c75c9cb75 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Going to try to stop instance {{(pid=123098) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 00:40:21.687933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9536bf7c-fb7f-4e53-afc7-191c75c9cb75 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/action" status: 202 len: 0 microversion: 2.1 time: 0.114029 Feb 21 00:40:21.688611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 214/397] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:40:21 2022] POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:40:21.696554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-76a20fc5-a0af-4298-8e8a-3f2540650b97 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:21.697438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-76a20fc5-a0af-4298-8e8a-3f2540650b97 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:21.703568 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-76a20fc5-a0af-4298-8e8a-3f2540650b97 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:21.704022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-76a20fc5-a0af-4298-8e8a-3f2540650b97 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:21.704946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-76a20fc5-a0af-4298-8e8a-3f2540650b97 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:21.705339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-76a20fc5-a0af-4298-8e8a-3f2540650b97 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:21.844126 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-76a20fc5-a0af-4298-8e8a-3f2540650b97 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:21.852358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-76a20fc5-a0af-4298-8e8a-3f2540650b97 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.159432 Feb 21 00:40:21.852927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 184/398] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:21 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:22.002763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-321e7428-780d-40c5-b3fc-8cc86d940cb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:22.003910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-321e7428-780d-40c5-b3fc-8cc86d940cb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:22.014310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-321e7428-780d-40c5-b3fc-8cc86d940cb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.014764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-321e7428-780d-40c5-b3fc-8cc86d940cb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.015541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-321e7428-780d-40c5-b3fc-8cc86d940cb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.015973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-321e7428-780d-40c5-b3fc-8cc86d940cb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.159123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-321e7428-780d-40c5-b3fc-8cc86d940cb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:22.167093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-321e7428-780d-40c5-b3fc-8cc86d940cb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.171052 Feb 21 00:40:22.167656 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 215/399] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:21 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:22.565603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-3b4a9f4e-e52e-4344-80ce-05cb52fe4d47 req-028b7b46-0316-4328-8868-696d49035979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e018349-6a79-41ca-89e4-86d1bf355cd0", "name": "network-vif-plugged", "status": "completed", "tag": "01160744-2091-4d9b-9585-581bf4da5aa7"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:22.567959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:22.567959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:40:22.575693 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-3b4a9f4e-e52e-4344-80ce-05cb52fe4d47 req-028b7b46-0316-4328-8868-696d49035979 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.576336 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-3b4a9f4e-e52e-4344-80ce-05cb52fe4d47 req-028b7b46-0316-4328-8868-696d49035979 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.589029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-3b4a9f4e-e52e-4344-80ce-05cb52fe4d47 req-028b7b46-0316-4328-8868-696d49035979 service nova] Creating event network-vif-plugged:01160744-2091-4d9b-9585-581bf4da5aa7 for instance 1e018349-6a79-41ca-89e4-86d1bf355cd0 on hv-cinder-81322 Feb 21 00:40:22.592754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:22.593531 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:22.594807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-3b4a9f4e-e52e-4344-80ce-05cb52fe4d47 req-028b7b46-0316-4328-8868-696d49035979 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032855 Feb 21 00:40:22.596003 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 185/400] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:22.601542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.602298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-91f5e371-e7e2-4d03-b222-9b793395d450 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:22.602426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.603436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.603558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-91f5e371-e7e2-4d03-b222-9b793395d450 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:22.604182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.610669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91f5e371-e7e2-4d03-b222-9b793395d450 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.611113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91f5e371-e7e2-4d03-b222-9b793395d450 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.611894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91f5e371-e7e2-4d03-b222-9b793395d450 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.612317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91f5e371-e7e2-4d03-b222-9b793395d450 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.766199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-91f5e371-e7e2-4d03-b222-9b793395d450 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:22.773608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-91f5e371-e7e2-4d03-b222-9b793395d450 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.176424 Feb 21 00:40:22.774171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 186/401] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:22 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:22.869094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f4622f55-602e-4aee-94ab-3f71bfa4c2cd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:22.869786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f4622f55-602e-4aee-94ab-3f71bfa4c2cd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:22.875916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4622f55-602e-4aee-94ab-3f71bfa4c2cd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.876436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4622f55-602e-4aee-94ab-3f71bfa4c2cd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.877340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4622f55-602e-4aee-94ab-3f71bfa4c2cd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:22.877774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4622f55-602e-4aee-94ab-3f71bfa4c2cd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:22.934593 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:22.944184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:22.945705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:22.946988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4601d46a-b435-4457-a1e9-4d574fee18be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.360699 Feb 21 00:40:22.948754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 216/402] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:23.027593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f4622f55-602e-4aee-94ab-3f71bfa4c2cd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:23.035948 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f4622f55-602e-4aee-94ab-3f71bfa4c2cd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.170561 Feb 21 00:40:23.036536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 187/403] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:22 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:23.183775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9c193110-cbc5-4572-82f6-eb5ce2d114f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:23.184594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9c193110-cbc5-4572-82f6-eb5ce2d114f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:23.191402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c193110-cbc5-4572-82f6-eb5ce2d114f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:23.191949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c193110-cbc5-4572-82f6-eb5ce2d114f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:23.192845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c193110-cbc5-4572-82f6-eb5ce2d114f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:23.193349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c193110-cbc5-4572-82f6-eb5ce2d114f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:23.329888 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9c193110-cbc5-4572-82f6-eb5ce2d114f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:23.337308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9c193110-cbc5-4572-82f6-eb5ce2d114f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.157123 Feb 21 00:40:23.337876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 217/404] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:23 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:23.790434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b397743a-6253-46ef-8737-2981b5c530a6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:23.791016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b397743a-6253-46ef-8737-2981b5c530a6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:23.797758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b397743a-6253-46ef-8737-2981b5c530a6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:23.798205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b397743a-6253-46ef-8737-2981b5c530a6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:23.798996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b397743a-6253-46ef-8737-2981b5c530a6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:23.799428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b397743a-6253-46ef-8737-2981b5c530a6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:23.934679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b397743a-6253-46ef-8737-2981b5c530a6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:23.942292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b397743a-6253-46ef-8737-2981b5c530a6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.155571 Feb 21 00:40:23.942859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 188/405] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:23 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:23.964719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:23.965324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:23.971247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:23.971791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:23.972467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:23.972905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:24.053071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6b168583-8946-4c5c-a688-ae81ea55522e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:24.054139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6b168583-8946-4c5c-a688-ae81ea55522e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:24.062054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b168583-8946-4c5c-a688-ae81ea55522e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:24.062547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b168583-8946-4c5c-a688-ae81ea55522e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:24.063392 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b168583-8946-4c5c-a688-ae81ea55522e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:24.064331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b168583-8946-4c5c-a688-ae81ea55522e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:24.109562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:24.117575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:24.119048 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:24.120149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d715ef02-7f35-4a9b-84fd-3ccbecb5ecdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.159166 Feb 21 00:40:24.120885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 218/406] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:24.200543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6b168583-8946-4c5c-a688-ae81ea55522e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:24.208835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6b168583-8946-4c5c-a688-ae81ea55522e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.159465 Feb 21 00:40:24.209439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 189/407] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:24 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:24.354180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3eda34ac-805c-495f-9396-7f6b1abc2590 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:24.355480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3eda34ac-805c-495f-9396-7f6b1abc2590 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:24.361003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3eda34ac-805c-495f-9396-7f6b1abc2590 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:24.364499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3eda34ac-805c-495f-9396-7f6b1abc2590 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:24.364499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3eda34ac-805c-495f-9396-7f6b1abc2590 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:24.364499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3eda34ac-805c-495f-9396-7f6b1abc2590 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:24.515027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3eda34ac-805c-495f-9396-7f6b1abc2590 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:24.522634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3eda34ac-805c-495f-9396-7f6b1abc2590 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1358 microversion: 2.1 time: 0.171932 Feb 21 00:40:24.523544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 219/408] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:24 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:24.958845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fb1c23fd-1fc0-4752-b8dd-f6b69b4d2ce7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:24.959481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fb1c23fd-1fc0-4752-b8dd-f6b69b4d2ce7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:24.966012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb1c23fd-1fc0-4752-b8dd-f6b69b4d2ce7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:24.966466 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb1c23fd-1fc0-4752-b8dd-f6b69b4d2ce7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:24.967238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb1c23fd-1fc0-4752-b8dd-f6b69b4d2ce7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:24.967685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb1c23fd-1fc0-4752-b8dd-f6b69b4d2ce7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.110527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fb1c23fd-1fc0-4752-b8dd-f6b69b4d2ce7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:25.118619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fb1c23fd-1fc0-4752-b8dd-f6b69b4d2ce7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.163110 Feb 21 00:40:25.119088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 190/409] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:24 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:25.138184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:25.138943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:25.145087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.145527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.146346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.146826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.227871 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2972418a-aaca-47a0-b2de-4f51f8b65421 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:25.228826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2972418a-aaca-47a0-b2de-4f51f8b65421 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:25.235341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2972418a-aaca-47a0-b2de-4f51f8b65421 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.236160 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2972418a-aaca-47a0-b2de-4f51f8b65421 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.237177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2972418a-aaca-47a0-b2de-4f51f8b65421 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.237625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2972418a-aaca-47a0-b2de-4f51f8b65421 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.289219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:25.297141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:25.298619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:25.299773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2a421c29-f9be-4a0d-b10b-87a4fc23dfb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.165417 Feb 21 00:40:25.300330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 220/410] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:25.390676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2972418a-aaca-47a0-b2de-4f51f8b65421 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:25.399108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2972418a-aaca-47a0-b2de-4f51f8b65421 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.175368 Feb 21 00:40:25.399676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 191/411] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:25 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:25.539349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b04f1540-d00a-4733-8178-294afc46cf65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:25.539946 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b04f1540-d00a-4733-8178-294afc46cf65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:25.546527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b04f1540-d00a-4733-8178-294afc46cf65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.546962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b04f1540-d00a-4733-8178-294afc46cf65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.547723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b04f1540-d00a-4733-8178-294afc46cf65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.548143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b04f1540-d00a-4733-8178-294afc46cf65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.689868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b04f1540-d00a-4733-8178-294afc46cf65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:25.697631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b04f1540-d00a-4733-8178-294afc46cf65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1548 microversion: 2.1 time: 0.161962 Feb 21 00:40:25.698200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 221/412] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:25 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:25.717396 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5c8a0645-ae65-4b9a-8435-b5cbdd05b257 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:25.718071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5c8a0645-ae65-4b9a-8435-b5cbdd05b257 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:25.724693 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c8a0645-ae65-4b9a-8435-b5cbdd05b257 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.725144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c8a0645-ae65-4b9a-8435-b5cbdd05b257 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.725913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c8a0645-ae65-4b9a-8435-b5cbdd05b257 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.726339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c8a0645-ae65-4b9a-8435-b5cbdd05b257 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.868179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5c8a0645-ae65-4b9a-8435-b5cbdd05b257 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:25.876017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5c8a0645-ae65-4b9a-8435-b5cbdd05b257 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1548 microversion: 2.1 time: 0.163655 Feb 21 00:40:25.877334 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 192/413] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:25 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:25.893075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:25.896637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:25.896637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:40:25.897613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:25.898349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Searching by: {'deleted': False, 'project_id': '5b7eecd8ed19485e9351a92ac0268585'} {{(pid=123098) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 21 00:40:25.905379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.905814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.906616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:25.907042 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:25.999851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.multi_cell_list [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123098) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 21 00:40:26.102126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-688b49d9-46b3-41a5-8e57-a9563e8cb0bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213284 Feb 21 00:40:26.102821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 222/414] 10.222.0.72 () {58 vars in 1124 bytes} [Mon Feb 21 00:40:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:26.112784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7ee1afa8-6375-421e-aad9-5a46dba22c8d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:26.113428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7ee1afa8-6375-421e-aad9-5a46dba22c8d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:26.120005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ee1afa8-6375-421e-aad9-5a46dba22c8d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:26.120506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ee1afa8-6375-421e-aad9-5a46dba22c8d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:26.121274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ee1afa8-6375-421e-aad9-5a46dba22c8d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:26.121708 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ee1afa8-6375-421e-aad9-5a46dba22c8d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:26.134706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-06c721c0-a35d-4993-b2de-2d52b5423b6b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:26.135374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-06c721c0-a35d-4993-b2de-2d52b5423b6b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:26.141386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06c721c0-a35d-4993-b2de-2d52b5423b6b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:26.141987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06c721c0-a35d-4993-b2de-2d52b5423b6b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:26.142592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06c721c0-a35d-4993-b2de-2d52b5423b6b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:26.143022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06c721c0-a35d-4993-b2de-2d52b5423b6b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:26.258364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7ee1afa8-6375-421e-aad9-5a46dba22c8d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:26.266261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7ee1afa8-6375-421e-aad9-5a46dba22c8d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1548 microversion: 2.1 time: 0.157141 Feb 21 00:40:26.266803 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 193/415] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:26 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:26.281221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-06c721c0-a35d-4993-b2de-2d52b5423b6b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:26.289159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-06c721c0-a35d-4993-b2de-2d52b5423b6b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.157787 Feb 21 00:40:26.298735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 223/416] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:26 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:26.317720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:26.318475 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:26.324618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:26.325060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:26.325869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:26.326267 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:26.416333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-14b3cc83-05d9-4f6d-ab0d-c10a85dad6eb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:26.417186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-14b3cc83-05d9-4f6d-ab0d-c10a85dad6eb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:26.424044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-14b3cc83-05d9-4f6d-ab0d-c10a85dad6eb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:26.424582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-14b3cc83-05d9-4f6d-ab0d-c10a85dad6eb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:26.425523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-14b3cc83-05d9-4f6d-ab0d-c10a85dad6eb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:26.426100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-14b3cc83-05d9-4f6d-ab0d-c10a85dad6eb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:26.470671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:26.481816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:26.483350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:26.484794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4736a707-59fa-41a9-a4f4-3662a1002be8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.170895 Feb 21 00:40:26.485340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 194/417] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:26.585563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-14b3cc83-05d9-4f6d-ab0d-c10a85dad6eb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:26.596405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-14b3cc83-05d9-4f6d-ab0d-c10a85dad6eb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.183169 Feb 21 00:40:26.597715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 224/418] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:26 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:27.309329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-31c5be89-67da-4c61-8e5c-a5764721f304 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:27.310102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-31c5be89-67da-4c61-8e5c-a5764721f304 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:27.319040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-67da-4c61-8e5c-a5764721f304 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:27.319680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-67da-4c61-8e5c-a5764721f304 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:27.320966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-67da-4c61-8e5c-a5764721f304 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:27.325542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-67da-4c61-8e5c-a5764721f304 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:27.480345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31c5be89-67da-4c61-8e5c-a5764721f304 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:27.487873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-31c5be89-67da-4c61-8e5c-a5764721f304 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.184227 Feb 21 00:40:27.488451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 195/419] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:27 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:27.502505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:27.503095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:27.509186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:27.509723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:27.510558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:27.511014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:27.613641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b7e0295e-1c8c-437d-a244-3590b1f1977e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:27.614855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b7e0295e-1c8c-437d-a244-3590b1f1977e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:27.623559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7e0295e-1c8c-437d-a244-3590b1f1977e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:27.624017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7e0295e-1c8c-437d-a244-3590b1f1977e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:27.624845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7e0295e-1c8c-437d-a244-3590b1f1977e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:27.625284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7e0295e-1c8c-437d-a244-3590b1f1977e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:27.673957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:27.682100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:27.683565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:27.684852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7d0cf673-56aa-4a5a-910e-8d7f59beab24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.186637 Feb 21 00:40:27.685824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 225/420] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:27.766633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b7e0295e-1c8c-437d-a244-3590b1f1977e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:27.774400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b7e0295e-1c8c-437d-a244-3590b1f1977e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.164809 Feb 21 00:40:27.774928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 196/421] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:27 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:27.809190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-90be2b2f-65cd-4df4-a6e0-3b7d3a1f9b0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c134cbee-c21d-4e8c-bf33-9f5afd7fe771"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:27.810416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-90be2b2f-65cd-4df4-a6e0-3b7d3a1f9b0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:27.816603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90be2b2f-65cd-4df4-a6e0-3b7d3a1f9b0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:27.817055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90be2b2f-65cd-4df4-a6e0-3b7d3a1f9b0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:27.817811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90be2b2f-65cd-4df4-a6e0-3b7d3a1f9b0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:27.818230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90be2b2f-65cd-4df4-a6e0-3b7d3a1f9b0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:28.083399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-90be2b2f-65cd-4df4-a6e0-3b7d3a1f9b0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "POST /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277724 Feb 21 00:40:28.084491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 226/422] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 00:40:27 2022] POST /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:28.507189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b6b67687-35af-4d62-94d0-74ade217c717 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:28.507796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b6b67687-35af-4d62-94d0-74ade217c717 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:28.514259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b6b67687-35af-4d62-94d0-74ade217c717 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:28.514712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b6b67687-35af-4d62-94d0-74ade217c717 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:28.515762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b6b67687-35af-4d62-94d0-74ade217c717 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:28.516186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b6b67687-35af-4d62-94d0-74ade217c717 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:28.663075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b6b67687-35af-4d62-94d0-74ade217c717 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:28.671726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b6b67687-35af-4d62-94d0-74ade217c717 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.168128 Feb 21 00:40:28.672549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 197/423] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:28 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:28.704000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:28.704643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:28.711508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:28.711947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:28.712738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:28.713156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:28.792137 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1297c72e-37ee-4bf6-b08b-7da210f601fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:28.793148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1297c72e-37ee-4bf6-b08b-7da210f601fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:28.799804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1297c72e-37ee-4bf6-b08b-7da210f601fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:28.800558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1297c72e-37ee-4bf6-b08b-7da210f601fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:28.801387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1297c72e-37ee-4bf6-b08b-7da210f601fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:28.801822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1297c72e-37ee-4bf6-b08b-7da210f601fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:28.863064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:28.871082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:28.872669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:28.873888 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bb373f0f-8e09-4c6f-a7fe-017cd0dfb223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.174670 Feb 21 00:40:28.874523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 227/424] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:28.938333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1297c72e-37ee-4bf6-b08b-7da210f601fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:28.946581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1297c72e-37ee-4bf6-b08b-7da210f601fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.158605 Feb 21 00:40:28.947130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 198/425] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:28 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:29.693150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-60d9572a-147b-4cbb-bf52-7dc76b9a3f67 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:29.694134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-60d9572a-147b-4cbb-bf52-7dc76b9a3f67 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:29.703389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60d9572a-147b-4cbb-bf52-7dc76b9a3f67 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:29.703831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60d9572a-147b-4cbb-bf52-7dc76b9a3f67 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:29.704638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60d9572a-147b-4cbb-bf52-7dc76b9a3f67 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:29.705211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60d9572a-147b-4cbb-bf52-7dc76b9a3f67 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:29.851838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-60d9572a-147b-4cbb-bf52-7dc76b9a3f67 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:29.859718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-60d9572a-147b-4cbb-bf52-7dc76b9a3f67 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.172803 Feb 21 00:40:29.860304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 228/426] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:29 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:29.892661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:29.893215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:29.899945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:29.900423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:29.901189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:29.901617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:29.963085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9f1d9071-2265-41ea-9bf0-834dd38bfb58 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:29.963719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9f1d9071-2265-41ea-9bf0-834dd38bfb58 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:29.969894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9f1d9071-2265-41ea-9bf0-834dd38bfb58 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:29.970305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9f1d9071-2265-41ea-9bf0-834dd38bfb58 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:29.971276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9f1d9071-2265-41ea-9bf0-834dd38bfb58 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:29.971736 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9f1d9071-2265-41ea-9bf0-834dd38bfb58 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:30.057882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:30.066725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:30.068209 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:30.069381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3661e62b-e590-4f0d-a10b-58c3be32cc75 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1724 microversion: 2.20 time: 0.180764 Feb 21 00:40:30.069940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 199/427] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:30.120184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9f1d9071-2265-41ea-9bf0-834dd38bfb58 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:30.127931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9f1d9071-2265-41ea-9bf0-834dd38bfb58 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.168703 Feb 21 00:40:30.128563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 229/428] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:29 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:30.881182 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-da656c90-41ce-4445-9703-0366cde03a0b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:30.882370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-da656c90-41ce-4445-9703-0366cde03a0b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:30.893096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-da656c90-41ce-4445-9703-0366cde03a0b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:30.894149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-da656c90-41ce-4445-9703-0366cde03a0b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:30.895164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-da656c90-41ce-4445-9703-0366cde03a0b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:30.895875 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-da656c90-41ce-4445-9703-0366cde03a0b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:31.048053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-da656c90-41ce-4445-9703-0366cde03a0b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:31.055653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-da656c90-41ce-4445-9703-0366cde03a0b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.181143 Feb 21 00:40:31.056297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 200/429] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:30 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:31.087151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:31.087828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:31.094213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:31.094672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:31.095444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:31.095894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:31.144800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1228c6e6-7126-4bb6-bc19-fda6cb49afd0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:31.145404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1228c6e6-7126-4bb6-bc19-fda6cb49afd0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:31.151848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1228c6e6-7126-4bb6-bc19-fda6cb49afd0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:31.152313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1228c6e6-7126-4bb6-bc19-fda6cb49afd0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:31.153119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1228c6e6-7126-4bb6-bc19-fda6cb49afd0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:31.153540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1228c6e6-7126-4bb6-bc19-fda6cb49afd0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:31.241262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:31.249700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:31.251194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:31.252443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5e9cce08-2114-48a3-87f8-8414053ca876 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1745 microversion: 2.20 time: 0.169192 Feb 21 00:40:31.253360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 230/430] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:40:31.299050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1228c6e6-7126-4bb6-bc19-fda6cb49afd0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:31.306806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1228c6e6-7126-4bb6-bc19-fda6cb49afd0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.165703 Feb 21 00:40:31.307372 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 201/431] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:31 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:32.072552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c285cbd1-4ba3-49ff-9582-c77c3f3cdc9d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:32.073252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c285cbd1-4ba3-49ff-9582-c77c3f3cdc9d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:32.079699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c285cbd1-4ba3-49ff-9582-c77c3f3cdc9d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:32.080165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c285cbd1-4ba3-49ff-9582-c77c3f3cdc9d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:32.081014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c285cbd1-4ba3-49ff-9582-c77c3f3cdc9d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:32.081464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c285cbd1-4ba3-49ff-9582-c77c3f3cdc9d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:32.221943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c285cbd1-4ba3-49ff-9582-c77c3f3cdc9d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:32.229505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c285cbd1-4ba3-49ff-9582-c77c3f3cdc9d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.160743 Feb 21 00:40:32.230061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 231/432] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:32 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:32.270587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:32.271154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:32.279044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:32.279484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:32.280264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:32.280756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:32.328813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9c7fb840-f205-44a0-9d5d-06258c73cd1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:32.329344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9c7fb840-f205-44a0-9d5d-06258c73cd1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:32.335274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c7fb840-f205-44a0-9d5d-06258c73cd1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:32.335712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c7fb840-f205-44a0-9d5d-06258c73cd1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:32.336779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c7fb840-f205-44a0-9d5d-06258c73cd1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:32.337206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c7fb840-f205-44a0-9d5d-06258c73cd1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:32.421408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:32.432087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:32.433624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:32.434792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bad3b5cf-3ca6-451c-9b8e-8924bf10d58f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1745 microversion: 2.20 time: 0.167970 Feb 21 00:40:32.435596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 202/433] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:32.477734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9c7fb840-f205-44a0-9d5d-06258c73cd1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:32.485758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9c7fb840-f205-44a0-9d5d-06258c73cd1b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.166292 Feb 21 00:40:32.486303 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 232/434] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:32 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:33.252885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2e8a6328-1416-4c45-9d69-7df3d46524c4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:33.254045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2e8a6328-1416-4c45-9d69-7df3d46524c4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:33.263199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2e8a6328-1416-4c45-9d69-7df3d46524c4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:33.263772 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2e8a6328-1416-4c45-9d69-7df3d46524c4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:33.265474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2e8a6328-1416-4c45-9d69-7df3d46524c4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:33.266005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2e8a6328-1416-4c45-9d69-7df3d46524c4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:33.427919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2e8a6328-1416-4c45-9d69-7df3d46524c4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:33.441646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2e8a6328-1416-4c45-9d69-7df3d46524c4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.194542 Feb 21 00:40:33.442470 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 203/435] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:33 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:33.453805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:33.454387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:33.461100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:33.461535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:33.462481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:33.463224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:33.503131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2bb642ec-0a90-4ae0-9385-c27d8ec75658 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:33.503772 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2bb642ec-0a90-4ae0-9385-c27d8ec75658 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:33.510550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2bb642ec-0a90-4ae0-9385-c27d8ec75658 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:33.510997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2bb642ec-0a90-4ae0-9385-c27d8ec75658 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:33.511866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2bb642ec-0a90-4ae0-9385-c27d8ec75658 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:33.512285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2bb642ec-0a90-4ae0-9385-c27d8ec75658 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:33.611918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:33.619925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:33.621373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:33.622663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ea647c1c-d745-430f-89ef-aa740bce394e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1745 microversion: 2.20 time: 0.172761 Feb 21 00:40:33.623233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 233/436] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:33.660402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2bb642ec-0a90-4ae0-9385-c27d8ec75658 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:33.671755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2bb642ec-0a90-4ae0-9385-c27d8ec75658 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.172422 Feb 21 00:40:33.672327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 204/437] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:33 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:34.458575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e8bcdbbb-04e1-42eb-8af2-da53b915a6ed tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:34.459177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e8bcdbbb-04e1-42eb-8af2-da53b915a6ed tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:34.465597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e8bcdbbb-04e1-42eb-8af2-da53b915a6ed tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:34.466129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e8bcdbbb-04e1-42eb-8af2-da53b915a6ed tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:34.466892 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e8bcdbbb-04e1-42eb-8af2-da53b915a6ed tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:34.467315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e8bcdbbb-04e1-42eb-8af2-da53b915a6ed tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:34.613597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e8bcdbbb-04e1-42eb-8af2-da53b915a6ed tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:34.621602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e8bcdbbb-04e1-42eb-8af2-da53b915a6ed tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.166646 Feb 21 00:40:34.622196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 234/438] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:34 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:34.640480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:34.641178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:34.647425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:34.647865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:34.648688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:34.649169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:34.663224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-ae8585e0-0327-4d28-b67e-31a2e95f0101 req-958820c7-8699-4219-9df6-6a3e4fd49a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf1e55d-f089-4700-84ba-c7daee664ac5", "name": "network-vif-plugged", "status": "completed", "tag": "91e1b094-1b34-4120-8622-d4c4e422029c"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:34.665218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:34.665218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:40:34.676123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-ae8585e0-0327-4d28-b67e-31a2e95f0101 req-958820c7-8699-4219-9df6-6a3e4fd49a28 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:34.676718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-ae8585e0-0327-4d28-b67e-31a2e95f0101 req-958820c7-8699-4219-9df6-6a3e4fd49a28 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:34.689357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-ae8585e0-0327-4d28-b67e-31a2e95f0101 req-958820c7-8699-4219-9df6-6a3e4fd49a28 service nova] Creating event network-vif-plugged:91e1b094-1b34-4120-8622-d4c4e422029c for instance eaf1e55d-f089-4700-84ba-c7daee664ac5 on hv-cinder-81322 Feb 21 00:40:34.694571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-ae8585e0-0327-4d28-b67e-31a2e95f0101 req-958820c7-8699-4219-9df6-6a3e4fd49a28 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035691 Feb 21 00:40:34.695583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 235/439] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:34.700905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7ebb896f-973f-41fc-b2b5-b78566ac39ef tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:34.701873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7ebb896f-973f-41fc-b2b5-b78566ac39ef tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:34.708164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7ebb896f-973f-41fc-b2b5-b78566ac39ef tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:34.708677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7ebb896f-973f-41fc-b2b5-b78566ac39ef tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:34.709466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7ebb896f-973f-41fc-b2b5-b78566ac39ef tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:34.709897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7ebb896f-973f-41fc-b2b5-b78566ac39ef tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:34.822401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:34.834630 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:34.836628 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:34.838596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ab6c781f-cd94-4022-821f-3dfdfe314a34 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1745 microversion: 2.20 time: 0.201874 Feb 21 00:40:34.839373 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 205/440] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:34.857604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7ebb896f-973f-41fc-b2b5-b78566ac39ef tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:34.866499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7ebb896f-973f-41fc-b2b5-b78566ac39ef tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.169928 Feb 21 00:40:34.867083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 236/441] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:34 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:35.638740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5e6d4ea4-d0c6-436b-a857-8bc17fcd338a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:35.639322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5e6d4ea4-d0c6-436b-a857-8bc17fcd338a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:35.646119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5e6d4ea4-d0c6-436b-a857-8bc17fcd338a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:35.646761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5e6d4ea4-d0c6-436b-a857-8bc17fcd338a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:35.647354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5e6d4ea4-d0c6-436b-a857-8bc17fcd338a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:35.647785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5e6d4ea4-d0c6-436b-a857-8bc17fcd338a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:35.794827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5e6d4ea4-d0c6-436b-a857-8bc17fcd338a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:35.803625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5e6d4ea4-d0c6-436b-a857-8bc17fcd338a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.168781 Feb 21 00:40:35.804205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 206/442] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:35 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:35.856883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:35.857473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:35.864252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:35.864728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:35.865500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:35.865924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:35.882840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a60168f3-d57f-4264-9c05-909a794bb888 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:35.883451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a60168f3-d57f-4264-9c05-909a794bb888 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:35.889689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a60168f3-d57f-4264-9c05-909a794bb888 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:35.890197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a60168f3-d57f-4264-9c05-909a794bb888 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:35.891166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a60168f3-d57f-4264-9c05-909a794bb888 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:35.891379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a60168f3-d57f-4264-9c05-909a794bb888 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:36.043937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a60168f3-d57f-4264-9c05-909a794bb888 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:36.052037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a60168f3-d57f-4264-9c05-909a794bb888 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1720 microversion: 2.1 time: 0.172679 Feb 21 00:40:36.052644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 207/443] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:35 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:36.229762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:36.238421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:36.240280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:36.241592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e779ef11-4776-4904-a312-5d527229837f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1745 microversion: 2.20 time: 0.388570 Feb 21 00:40:36.242223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 237/444] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:35 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1745 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:40:36.686895 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ae7575f6-d793-45a1-8c00-d0dff8529735 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:36.687547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ae7575f6-d793-45a1-8c00-d0dff8529735 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:36.695556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7575f6-d793-45a1-8c00-d0dff8529735 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:36.696110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7575f6-d793-45a1-8c00-d0dff8529735 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:36.696960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7575f6-d793-45a1-8c00-d0dff8529735 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:36.697591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7575f6-d793-45a1-8c00-d0dff8529735 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:36.714882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-01ac2c6b-b392-4ada-b3a0-f2eeadd5307c req-c1d7fdcf-557d-4ed8-96dd-ac534769fba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aa3b9a-864e-42ff-81ec-278e00ddd8be", "name": "network-vif-plugged", "status": "completed", "tag": "d8dbce75-bbb2-4b0b-bc43-c864b59621e9"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:36.717905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:36.717905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:40:36.726516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-01ac2c6b-b392-4ada-b3a0-f2eeadd5307c req-c1d7fdcf-557d-4ed8-96dd-ac534769fba6 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:36.727507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-01ac2c6b-b392-4ada-b3a0-f2eeadd5307c req-c1d7fdcf-557d-4ed8-96dd-ac534769fba6 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:36.740017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-01ac2c6b-b392-4ada-b3a0-f2eeadd5307c req-c1d7fdcf-557d-4ed8-96dd-ac534769fba6 service nova] Creating event network-vif-plugged:d8dbce75-bbb2-4b0b-bc43-c864b59621e9 for instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be on hv-cinder-81322 Feb 21 00:40:36.745359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-01ac2c6b-b392-4ada-b3a0-f2eeadd5307c req-c1d7fdcf-557d-4ed8-96dd-ac534769fba6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Feb 21 00:40:36.746185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 238/445] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:36.821399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f5d07703-0fa6-4136-abd6-efde324ff132 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:36.822011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f5d07703-0fa6-4136-abd6-efde324ff132 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:36.828970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f5d07703-0fa6-4136-abd6-efde324ff132 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:36.829415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f5d07703-0fa6-4136-abd6-efde324ff132 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:36.830234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f5d07703-0fa6-4136-abd6-efde324ff132 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:36.830604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f5d07703-0fa6-4136-abd6-efde324ff132 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:36.849090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ae7575f6-d793-45a1-8c00-d0dff8529735 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:36.858231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ae7575f6-d793-45a1-8c00-d0dff8529735 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1594 microversion: 2.1 time: 0.175168 Feb 21 00:40:36.859727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 208/446] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:36 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1594 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:37.065463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f5d07703-0fa6-4136-abd6-efde324ff132 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:37.071358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2eb8a93b-fe6a-4f5d-b643-6a5c1f744d06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:37.072280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2eb8a93b-fe6a-4f5d-b643-6a5c1f744d06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:37.075230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f5d07703-0fa6-4136-abd6-efde324ff132 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1265 microversion: 2.1 time: 0.258663 Feb 21 00:40:37.075876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 239/447] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:36 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:37.129449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2eb8a93b-fe6a-4f5d-b643-6a5c1f744d06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:37.130096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2eb8a93b-fe6a-4f5d-b643-6a5c1f744d06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:37.132082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2eb8a93b-fe6a-4f5d-b643-6a5c1f744d06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:37.140679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2eb8a93b-fe6a-4f5d-b643-6a5c1f744d06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:37.260683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:37.261291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:37.267875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:37.268322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:37.269139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:37.270219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:37.290132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2eb8a93b-fe6a-4f5d-b643-6a5c1f744d06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:37.298073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2eb8a93b-fe6a-4f5d-b643-6a5c1f744d06 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1697 microversion: 2.1 time: 0.232636 Feb 21 00:40:37.299039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 209/448] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:37 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:40:37.314933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a311c367-8d8e-4cca-9e53-6e8e72326973 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:37.321850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a311c367-8d8e-4cca-9e53-6e8e72326973 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:37.322451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a311c367-8d8e-4cca-9e53-6e8e72326973 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:37.387952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a311c367-8d8e-4cca-9e53-6e8e72326973 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Going to try to start instance {{(pid=123097) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 00:40:37.443749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a311c367-8d8e-4cca-9e53-6e8e72326973 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/action" status: 202 len: 0 microversion: 2.1 time: 0.131859 Feb 21 00:40:37.444591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 210/449] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:40:37 2022] POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 00:40:37.452896 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d7ec7364-8a8e-4a3a-b307-643bc111e909 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:37.454458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d7ec7364-8a8e-4a3a-b307-643bc111e909 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:37.461236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7ec7364-8a8e-4a3a-b307-643bc111e909 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:37.461756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7ec7364-8a8e-4a3a-b307-643bc111e909 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:37.462713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7ec7364-8a8e-4a3a-b307-643bc111e909 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:37.463170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7ec7364-8a8e-4a3a-b307-643bc111e909 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:37.596978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:37.607927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:37.610232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:37.611419 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ff2a875c-256f-446c-bb77-9df8b2161d59 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1745 microversion: 2.20 time: 0.354665 Feb 21 00:40:37.613650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 240/450] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:37 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1745 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:37.641115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d7ec7364-8a8e-4a3a-b307-643bc111e909 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:37.651613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d7ec7364-8a8e-4a3a-b307-643bc111e909 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1706 microversion: 2.1 time: 0.202460 Feb 21 00:40:37.652740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 211/451] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:37 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1706 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:38.176990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f2e4ebbe-4067-4356-b7bd-56b35a01d419 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:38.178462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f2e4ebbe-4067-4356-b7bd-56b35a01d419 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:38.187068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2e4ebbe-4067-4356-b7bd-56b35a01d419 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:38.187804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2e4ebbe-4067-4356-b7bd-56b35a01d419 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:38.188687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2e4ebbe-4067-4356-b7bd-56b35a01d419 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:38.189316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2e4ebbe-4067-4356-b7bd-56b35a01d419 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:38.629773 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:38.630524 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:38.650217 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:38.651132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:38.652116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:38.652761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:38.798833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f2e4ebbe-4067-4356-b7bd-56b35a01d419 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:38.808970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f2e4ebbe-4067-4356-b7bd-56b35a01d419 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1453 microversion: 2.1 time: 0.645813 Feb 21 00:40:38.811632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 241/452] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:38 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1453 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:38.821368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7a4eb317-b35c-4781-b8f6-4ad7ea2997a7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:38.821992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7a4eb317-b35c-4781-b8f6-4ad7ea2997a7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:38.837149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a4eb317-b35c-4781-b8f6-4ad7ea2997a7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:38.837604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a4eb317-b35c-4781-b8f6-4ad7ea2997a7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:38.844537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a4eb317-b35c-4781-b8f6-4ad7ea2997a7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:38.845349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a4eb317-b35c-4781-b8f6-4ad7ea2997a7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:38.862774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:38.877355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:38.879758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:38.881236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ac19d309-8145-4a1f-b696-35bf4f71548a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.255988 Feb 21 00:40:38.882208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 212/453] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:40:38.898811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5db30ac7-ff88-4bdb-80d0-b8fcde32e642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:38.902422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5db30ac7-ff88-4bdb-80d0-b8fcde32e642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:38.918987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5db30ac7-ff88-4bdb-80d0-b8fcde32e642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:38.919808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5db30ac7-ff88-4bdb-80d0-b8fcde32e642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:38.920860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5db30ac7-ff88-4bdb-80d0-b8fcde32e642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:38.921490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5db30ac7-ff88-4bdb-80d0-b8fcde32e642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:39.130269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5db30ac7-ff88-4bdb-80d0-b8fcde32e642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:39.138581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5db30ac7-ff88-4bdb-80d0-b8fcde32e642 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1453 microversion: 2.1 time: 0.244929 Feb 21 00:40:39.151590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 213/454] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:38 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1453 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:39.504343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7a4eb317-b35c-4781-b8f6-4ad7ea2997a7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:39.536599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7a4eb317-b35c-4781-b8f6-4ad7ea2997a7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1706 microversion: 2.1 time: 0.717707 Feb 21 00:40:39.538203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 242/455] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:38 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1706 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:39.901177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:39.902616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:39.914355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:39.915100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:39.920409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:39.921036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:40.446178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-b940fa8d-a666-4b70-bca1-0cc916cc4b9f req-67736a50-7d92-4c12-a1d5-6f348432ab5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e018349-6a79-41ca-89e4-86d1bf355cd0", "tag": "01160744-2091-4d9b-9585-581bf4da5aa7"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:40.457676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:40.457676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:40:40.507344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-b940fa8d-a666-4b70-bca1-0cc916cc4b9f req-67736a50-7d92-4c12-a1d5-6f348432ab5c service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:40.511166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-b940fa8d-a666-4b70-bca1-0cc916cc4b9f req-67736a50-7d92-4c12-a1d5-6f348432ab5c service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:40.549745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-b940fa8d-a666-4b70-bca1-0cc916cc4b9f req-67736a50-7d92-4c12-a1d5-6f348432ab5c service nova] Creating event network-changed:01160744-2091-4d9b-9585-581bf4da5aa7 for instance 1e018349-6a79-41ca-89e4-86d1bf355cd0 on hv-cinder-81322 Feb 21 00:40:40.568632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-b940fa8d-a666-4b70-bca1-0cc916cc4b9f req-67736a50-7d92-4c12-a1d5-6f348432ab5c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126287 Feb 21 00:40:40.569787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 243/456] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:40:40.584587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-08d2b3df-8cba-4282-aef5-68d99cb73dfd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:40.585625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-08d2b3df-8cba-4282-aef5-68d99cb73dfd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:40.592457 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-08d2b3df-8cba-4282-aef5-68d99cb73dfd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:40.593138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-08d2b3df-8cba-4282-aef5-68d99cb73dfd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:40.594082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-08d2b3df-8cba-4282-aef5-68d99cb73dfd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:40.594659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-08d2b3df-8cba-4282-aef5-68d99cb73dfd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:40.929384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-08d2b3df-8cba-4282-aef5-68d99cb73dfd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:40.941538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-08d2b3df-8cba-4282-aef5-68d99cb73dfd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1710 microversion: 2.1 time: 0.369585 Feb 21 00:40:40.943411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 244/457] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:40 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1710 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:40.999609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:41.008183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:41.015420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:41.016770 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fd0ce4f7-6033-4bc8-86ee-156b19d831bc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 1.121561 Feb 21 00:40:41.021502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 214/458] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:42.035860 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:42.036779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:42.053758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:42.054335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:42.059189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:42.060787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:42.158602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-27050e24-8a35-4ed8-ba7d-b9494dc9fc62 req-6a015865-0538-4ac6-b501-d64bdb12be75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf1e55d-f089-4700-84ba-c7daee664ac5", "tag": "91e1b094-1b34-4120-8622-d4c4e422029c"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:42.161333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:42.161333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:40:42.169214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-27050e24-8a35-4ed8-ba7d-b9494dc9fc62 req-6a015865-0538-4ac6-b501-d64bdb12be75 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:42.169958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-27050e24-8a35-4ed8-ba7d-b9494dc9fc62 req-6a015865-0538-4ac6-b501-d64bdb12be75 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:42.182124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-27050e24-8a35-4ed8-ba7d-b9494dc9fc62 req-6a015865-0538-4ac6-b501-d64bdb12be75 service nova] Creating event network-changed:91e1b094-1b34-4120-8622-d4c4e422029c for instance eaf1e55d-f089-4700-84ba-c7daee664ac5 on hv-cinder-81322 Feb 21 00:40:42.187776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-27050e24-8a35-4ed8-ba7d-b9494dc9fc62 req-6a015865-0538-4ac6-b501-d64bdb12be75 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035119 Feb 21 00:40:42.189012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 215/459] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:42.519003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:42.528431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:42.540214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:42.541640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-01888edd-65d3-4020-92f5-6244fbb54922 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.510824 Feb 21 00:40:42.545099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 245/460] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:42.646226 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1895ac93-0291-4f8e-9906-e1d1e59d0bb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-778247797"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:42.648328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1895ac93-0291-4f8e-9906-e1d1e59d0bb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:42.656860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1895ac93-0291-4f8e-9906-e1d1e59d0bb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:42.657492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1895ac93-0291-4f8e-9906-e1d1e59d0bb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:42.658647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1895ac93-0291-4f8e-9906-e1d1e59d0bb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:42.660054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1895ac93-0291-4f8e-9906-e1d1e59d0bb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:42.828355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.network.security_group_api [None req-1895ac93-0291-4f8e-9906-e1d1e59d0bb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Adding security group 83a66486-9401-4aeb-a5e3-6999eea89fc4 to port 01160744-2091-4d9b-9585-581bf4da5aa7 Feb 21 00:40:43.316956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1895ac93-0291-4f8e-9906-e1d1e59d0bb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "POST /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/action" status: 202 len: 0 microversion: 2.1 time: 0.674594 Feb 21 00:40:43.319117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 216/461] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:40:42 2022] POST /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/action => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:40:43.327626 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-246b53e3-b869-4931-98cd-4c2a7c596de1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:43.328785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-246b53e3-b869-4931-98cd-4c2a7c596de1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:43.345567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-246b53e3-b869-4931-98cd-4c2a7c596de1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:43.346149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-246b53e3-b869-4931-98cd-4c2a7c596de1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:43.347032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-246b53e3-b869-4931-98cd-4c2a7c596de1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:43.347489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-246b53e3-b869-4931-98cd-4c2a7c596de1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:43.558032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-246b53e3-b869-4931-98cd-4c2a7c596de1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:43.560135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:43.560834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:43.568635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-246b53e3-b869-4931-98cd-4c2a7c596de1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1758 microversion: 2.1 time: 0.245920 Feb 21 00:40:43.573479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:43.574188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:43.578176 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:43.583260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:43.585571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 246/462] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:40:43 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1758 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:40:43.859573 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:43.867756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:43.869269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:43.870427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-23478d59-647c-4172-be10-d6f48b57f803 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.314319 Feb 21 00:40:43.870987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 217/463] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:40:44.203547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-85ef3cb4-c7f4-43c7-a0e6-51649121a513 req-0274502d-cb08-46a0-889a-2e7db243c4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e018349-6a79-41ca-89e4-86d1bf355cd0", "tag": "01160744-2091-4d9b-9585-581bf4da5aa7"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:44.205215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:44.205215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:40:44.212186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-85ef3cb4-c7f4-43c7-a0e6-51649121a513 req-0274502d-cb08-46a0-889a-2e7db243c4f3 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:44.213149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-85ef3cb4-c7f4-43c7-a0e6-51649121a513 req-0274502d-cb08-46a0-889a-2e7db243c4f3 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:44.224993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-85ef3cb4-c7f4-43c7-a0e6-51649121a513 req-0274502d-cb08-46a0-889a-2e7db243c4f3 service nova] Creating event network-changed:01160744-2091-4d9b-9585-581bf4da5aa7 for instance 1e018349-6a79-41ca-89e4-86d1bf355cd0 on hv-cinder-81322 Feb 21 00:40:44.230095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-85ef3cb4-c7f4-43c7-a0e6-51649121a513 req-0274502d-cb08-46a0-889a-2e7db243c4f3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030189 Feb 21 00:40:44.230878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 247/464] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:40:44.888013 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:44.889311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:44.896148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:44.896882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:44.897756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:44.898258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:45.041946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:45.050029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:45.051517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:45.052670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9261819e-a96a-4738-8f0f-ea83438775bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.168265 Feb 21 00:40:45.053268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 218/465] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:44 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:46.071361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:46.072782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:46.079856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:46.080422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:46.081198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:46.081619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:46.220154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:46.228418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:46.230257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:46.232465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9857a3ba-0e2a-498a-9a05-0759ae3c6b32 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.165804 Feb 21 00:40:46.233204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 248/466] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:47.251347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:47.252168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:47.258868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:47.260817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:47.262326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:47.262818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:47.419346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:47.430688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:47.432520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:47.433705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ae58531f-c5b3-4453-8da7-43c03e6c6518 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.186159 Feb 21 00:40:47.445265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 219/467] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:47 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:48.452642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:48.453900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:48.460782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:48.461505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:48.462962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:48.463577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:48.611156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:48.619916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:48.621876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:48.623117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7da05462-f544-4c0e-8c4d-4563d975f914 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.174605 Feb 21 00:40:48.623987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 249/468] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:49.641300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:49.641872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:49.648636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:49.649354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:49.650177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:49.650793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:49.801883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:49.810386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:49.812501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:49.813785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8cfa257b-0dc0-48e8-9a2a-9980a4b5b046 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.176350 Feb 21 00:40:49.814884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 220/469] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:50.832139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:50.833115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:50.839725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:50.840694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:50.841885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:50.842419 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:50.983134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:50.991388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:50.993000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:50.994398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2abf4cdb-62fe-4df1-8113-dcec9e1cb436 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.166445 Feb 21 00:40:50.995058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 250/470] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:50 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:52.012636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:52.013281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:52.020231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:52.020701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:52.021469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:52.021894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:52.162902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:52.170825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:52.172303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:52.173482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-87b4843d-1019-471f-847c-52b4463e41c3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.164811 Feb 21 00:40:52.174040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 221/471] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:53.195332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:53.196182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:53.207188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:53.207928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:53.209270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:53.209981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:53.363281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:53.371701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:53.373268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:53.374401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3dfff5da-60b8-4b2b-ab79-04c7b6e6a294 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.185465 Feb 21 00:40:53.374966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 251/472] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:53 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:54.396308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:54.397423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:54.408153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:54.408947 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:54.410636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:54.411359 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:54.551314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:54.559626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:54.561151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:54.562294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e4a221f4-4c36-4784-aee4-497812dec973 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1740 microversion: 2.20 time: 0.172213 Feb 21 00:40:54.562890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 222/473] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:54 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:55.580527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:55.581135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:55.588722 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:55.589156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:55.589938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:55.590410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:55.945161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:55.953659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:55.955149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:55.956311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3cde399c-1b4f-4d98-a965-45d34b74e7b9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1722 microversion: 2.20 time: 0.379760 Feb 21 00:40:55.956911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 252/474] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:56.983058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:56.983911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:56.994551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:56.995318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:56.996673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:56.997108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:57.139028 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:57.147347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:57.148846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:57.149987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-53c9c30c-84a9-4649-9aac-375e644c01e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1722 microversion: 2.20 time: 0.173429 Feb 21 00:40:57.150562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 223/475] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:56 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:58.173160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:58.174039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:58.184027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:58.184818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:58.186071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:58.186773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:58.327416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:58.336014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:58.337563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:58.338716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f8962466-4e7a-4c9e-a34c-cba0f47e0b69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1722 microversion: 2.20 time: 0.172635 Feb 21 00:40:58.339274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 253/476] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:58.696791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-895f70b3-e550-4a9b-9ff8-6f2b488fc416 req-2cf59c76-6155-4658-b08c-e884f414f48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aa3b9a-864e-42ff-81ec-278e00ddd8be", "name": "network-vif-unplugged", "status": "completed", "tag": "d8dbce75-bbb2-4b0b-bc43-c864b59621e9"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:58.698909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:40:58.698909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:40:58.705996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-895f70b3-e550-4a9b-9ff8-6f2b488fc416 req-2cf59c76-6155-4658-b08c-e884f414f48b service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:58.706435 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-895f70b3-e550-4a9b-9ff8-6f2b488fc416 req-2cf59c76-6155-4658-b08c-e884f414f48b service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:58.717641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-895f70b3-e550-4a9b-9ff8-6f2b488fc416 req-2cf59c76-6155-4658-b08c-e884f414f48b service nova] Creating event network-vif-unplugged:d8dbce75-bbb2-4b0b-bc43-c864b59621e9 for instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be on hv-cinder-81322 Feb 21 00:40:58.722803 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-895f70b3-e550-4a9b-9ff8-6f2b488fc416 req-2cf59c76-6155-4658-b08c-e884f414f48b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029993 Feb 21 00:40:58.723629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 224/477] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:40:59.361078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:40:59.362099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:59.372280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:59.372759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:59.373528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:59.373954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:59.516804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:59.525225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:59.526721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:40:59.527868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-330cf371-dab3-456e-b970-e1231f8b23fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1665 microversion: 2.20 time: 0.173548 Feb 21 00:40:59.528445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 254/478] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:40:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:40:59.546232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ef4fc6ec-b061-4b27-b735-b838ddf18149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7a814c9-9d04-498c-97fa-0a1547d5b0a6"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:59.547426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ef4fc6ec-b061-4b27-b735-b838ddf18149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:59.554179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef4fc6ec-b061-4b27-b735-b838ddf18149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:59.554623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef4fc6ec-b061-4b27-b735-b838ddf18149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:59.555397 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef4fc6ec-b061-4b27-b735-b838ddf18149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:59.555822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef4fc6ec-b061-4b27-b735-b838ddf18149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:59.841477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ef4fc6ec-b061-4b27-b735-b838ddf18149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "POST /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299536 Feb 21 00:40:59.842146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 225/479] 10.222.0.72 () {62 vars in 1363 bytes} [Mon Feb 21 00:40:59 2022] POST /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:40:59.955724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d502655c-a936-4321-b53c-07f52bb5aa50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:40:59.956292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d502655c-a936-4321-b53c-07f52bb5aa50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:40:59.962332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d502655c-a936-4321-b53c-07f52bb5aa50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:59.962766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d502655c-a936-4321-b53c-07f52bb5aa50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:40:59.963537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d502655c-a936-4321-b53c-07f52bb5aa50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:40:59.963968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d502655c-a936-4321-b53c-07f52bb5aa50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:00.057163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d502655c-a936-4321-b53c-07f52bb5aa50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "POST /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/action" status: 202 len: 0 microversion: 2.20 time: 0.105208 Feb 21 00:41:00.057682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 255/480] 10.222.0.72 () {62 vars in 1318 bytes} [Mon Feb 21 00:40:59 2022] POST /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:41:00.065762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:00.066369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:00.073155 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:00.073625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:00.074938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:00.074938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:00.208982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:00.218211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:00.219902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:00.221274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7d6e147f-1b3a-4e58-8f6b-c6a64371b654 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1751 microversion: 2.20 time: 0.159291 Feb 21 00:41:00.222322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 226/481] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:00 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:01.243595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:01.244643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:01.254834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:01.255571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:01.256896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:01.257608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:01.394554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:01.405359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:01.407291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:01.409430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f1a7fcac-420d-48d5-bc6b-b334b42614d5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1751 microversion: 2.20 time: 0.172611 Feb 21 00:41:01.409997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 256/482] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:02.431865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:02.432895 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:02.443471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:02.444218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:02.445559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:02.446685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:02.585954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:02.594503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:02.595992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:02.597167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e8c55ca0-7be5-4443-ba78-86d2be62d3ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1753 microversion: 2.20 time: 0.171645 Feb 21 00:41:02.597722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 227/483] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:03.615153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:03.615745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:03.621929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:03.622346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:03.623273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:03.623692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:03.757966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:03.766177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:03.767644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:03.768817 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-37817c12-f98b-437d-b4cf-1b4babdae470 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1753 microversion: 2.20 time: 0.157544 Feb 21 00:41:03.769376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 257/484] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:04.790968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:04.791967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:04.799179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:04.799621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:04.800411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:04.800851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:04.952459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:04.961542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:04.962963 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:04.964130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-88016d55-3559-4125-bb2e-c7a570aedb9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1753 microversion: 2.20 time: 0.179320 Feb 21 00:41:04.964712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 228/485] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:05.983395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:05.984671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:05.992295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:05.992978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:05.993777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:05.994205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:06.132414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:06.141435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:06.142915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:06.144081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a7bafaf5-ac7b-48b7-a2af-7482a2e1d81e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1753 microversion: 2.20 time: 0.165146 Feb 21 00:41:06.144682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 258/486] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:07.162637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:07.163226 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:07.174227 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:07.174666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:07.175522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:07.175944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:07.317228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:07.326318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:07.328060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:07.329502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7fa16172-7795-418c-920c-91b8f9b8bb69 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.170863 Feb 21 00:41:07.340595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 229/487] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:07 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:08.349942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:08.350549 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:08.357005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:08.357443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:08.358197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:08.358624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:08.507970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:08.516247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:08.517785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:08.518924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9290adb2-3205-4569-b1fd-96a8833946e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.175153 Feb 21 00:41:08.519479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 259/488] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:09.537767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:09.539059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:09.545868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:09.546356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:09.547201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:09.547682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:09.691153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:09.699936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:09.701484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:09.702660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ce4d7eb6-a4cf-40e2-81ed-8ba242b40db9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.169687 Feb 21 00:41:09.703335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 230/489] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:10.720900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:10.722223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:10.729581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:10.730132 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:10.730975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:10.731657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:10.868801 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:10.877454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:10.878959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:10.880119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-791e9974-e864-4694-a981-760b5b80a737 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.163189 Feb 21 00:41:10.880938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 260/490] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:10 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:11.898100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:11.899375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:11.905759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:11.906448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:11.907267 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:11.907697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:12.069274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:12.079597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:12.081402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:12.082742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-57dc8ee4-6ea0-485e-ab29-13b9964382c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.189040 Feb 21 00:41:12.083340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 231/491] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:41:13.100688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:13.101288 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:13.121517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:13.122110 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:13.122926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:13.123589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:13.277046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:13.286693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:13.288272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:13.289479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-551ba4bf-fa32-4e30-bdd5-9e56c3803be3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.192511 Feb 21 00:41:13.290042 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 261/492] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:14.308022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:14.309686 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:14.316900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:14.317543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:14.318493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:14.319196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:14.464600 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:14.473604 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:14.475195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:14.476509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f969bfd9-5001-4f18-86f7-03ec1636975f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.172439 Feb 21 00:41:14.477255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 232/493] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:15.495152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:15.495711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:15.507825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:15.508506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:15.509471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:15.510041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:15.679759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:15.692142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:15.693993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:15.695358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bb57345a-5c93-409d-913c-537044f9cc91 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.203911 Feb 21 00:41:15.695984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 262/494] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:16.713705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:16.714628 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:16.721300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:16.722085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:16.723751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:16.724339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:16.893277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:16.901727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:16.903690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:16.905176 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b2b3fede-cc18-41f0-b9db-6ff4e069f24e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.195726 Feb 21 00:41:16.916069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 233/495] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:17.929188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:17.929836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:17.943308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:17.944065 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:17.946092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:17.946586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:18.167086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:18.176945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:18.178436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:18.179599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f1a13e4b-ff93-4657-95e0-93b321ae52bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.254942 Feb 21 00:41:18.180320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 263/496] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:17 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:41:19.197355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:19.198459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:19.204981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:19.205562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:19.206511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:19.207046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:19.352595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:19.361126 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:19.362717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:19.363942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ff454ff0-3644-4ab3-9742-a06fe1f90907 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.170338 Feb 21 00:41:19.364609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 234/497] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:20.386187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:20.387301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:20.394033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:20.394480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:20.395256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:20.395689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:20.538406 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:20.548160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:20.549678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:20.550832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-81e05540-0192-4714-b97c-991b2eb074d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.170912 Feb 21 00:41:20.551429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 264/498] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:21.577040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:21.577722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:21.587588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:21.588022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:21.588825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:21.589249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:21.618271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1633699816", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "3d51b0ba-44df-4d2b-a4e2-f678b8211f66"}]}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:41:21.669251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] validate_networks() for [('3d51b0ba-44df-4d2b-a4e2-f678b8211f66', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:41:21.723890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:21.732889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:21.734366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:21.735501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e0cf2365-eac8-4bbf-a49c-5f84cf167228 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.162871 Feb 21 00:41:21.736029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 235/499] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:22.021556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:41:22.022070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:41:22.022744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:41:22.023286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:41:22.023825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:41:22.038316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:22.038845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:22.040042 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:22.040734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:22.058517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Getting quotas for project 57be6173077b4dedaa6514ff1841b515. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:41:22.062856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Getting quotas for user 45e624bab4554a3fa8e1a028a81b6c8b and project 57be6173077b4dedaa6514ff1841b515. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:41:22.074891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:41:22.077183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:41:22.120492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cbe08a35-8744-4124-9799-783df7139ded tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505813 Feb 21 00:41:22.121129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 265/500] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 00:41:22.130812 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a4598cee-cff1-4cc4-b8f2-21b038936876 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:22.131533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a4598cee-cff1-4cc4-b8f2-21b038936876 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:22.190940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a4598cee-cff1-4cc4-b8f2-21b038936876 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:22.197758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a4598cee-cff1-4cc4-b8f2-21b038936876 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1219 microversion: 2.1 time: 0.070632 Feb 21 00:41:22.198333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 236/501] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:22 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:22.753960 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:22.754564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:22.763567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:22.764023 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:22.764826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:22.765249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:22.903101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:22.912111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:22.913649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:22.914839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0d1977f3-3a45-4c41-96ae-81514d91fcc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.164647 Feb 21 00:41:22.915411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 266/502] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 00:41:23.214739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-52455c52-ab05-4a5a-a4a1-30a0e6487c8a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:23.215622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-52455c52-ab05-4a5a-a4a1-30a0e6487c8a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:23.223808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52455c52-ab05-4a5a-a4a1-30a0e6487c8a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:23.224258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52455c52-ab05-4a5a-a4a1-30a0e6487c8a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:23.225070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52455c52-ab05-4a5a-a4a1-30a0e6487c8a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:23.225515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52455c52-ab05-4a5a-a4a1-30a0e6487c8a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:23.291200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-52455c52-ab05-4a5a-a4a1-30a0e6487c8a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:23.298645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-52455c52-ab05-4a5a-a4a1-30a0e6487c8a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1277 microversion: 2.1 time: 0.087616 Feb 21 00:41:23.299214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 237/503] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:23 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:23.935222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:23.935819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:23.942188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:23.942766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:23.943601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:23.944034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:24.167830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:24.176852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:24.178321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:24.179527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-64d93661-e4d7-4a95-b4d0-965e6036c53b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.249798 Feb 21 00:41:24.190082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 267/504] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:24.315708 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-333d2e3d-597f-49e2-b694-aae6e09bdab8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:24.316379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-333d2e3d-597f-49e2-b694-aae6e09bdab8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:24.323091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-333d2e3d-597f-49e2-b694-aae6e09bdab8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:24.323542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-333d2e3d-597f-49e2-b694-aae6e09bdab8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:24.324324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-333d2e3d-597f-49e2-b694-aae6e09bdab8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:24.325533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-333d2e3d-597f-49e2-b694-aae6e09bdab8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:24.429711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-62d98818-a500-440d-a005-564578f1ae59 req-a61c2541-68e2-405a-b41f-37e098fa75b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c", "tag": "1187a97b-2a24-44bd-8064-9bcc8be5eb03"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:41:24.433421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:41:24.433421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:41:24.443046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-62d98818-a500-440d-a005-564578f1ae59 req-a61c2541-68e2-405a-b41f-37e098fa75b7 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:24.443813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-62d98818-a500-440d-a005-564578f1ae59 req-a61c2541-68e2-405a-b41f-37e098fa75b7 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:24.468038 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-333d2e3d-597f-49e2-b694-aae6e09bdab8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:24.470447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-62d98818-a500-440d-a005-564578f1ae59 req-a61c2541-68e2-405a-b41f-37e098fa75b7 service nova] Creating event network-changed:1187a97b-2a24-44bd-8064-9bcc8be5eb03 for instance 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c on hv-cinder-81322 Feb 21 00:41:24.475591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-333d2e3d-597f-49e2-b694-aae6e09bdab8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1319 microversion: 2.1 time: 0.163813 Feb 21 00:41:24.480431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 238/505] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:24 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:24.487281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-62d98818-a500-440d-a005-564578f1ae59 req-a61c2541-68e2-405a-b41f-37e098fa75b7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061919 Feb 21 00:41:24.487965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 268/506] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:41:25.196897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:25.197504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:25.204117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:25.204609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:25.205525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:25.205952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:25.340631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:25.349306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:25.350781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:25.351923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-42b810f5-b0ed-4afa-872e-66f266d72155 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.158857 Feb 21 00:41:25.352496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 239/507] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:25.497211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bf41adfe-451d-4ba2-856a-b353c28f48ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:25.498072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bf41adfe-451d-4ba2-856a-b353c28f48ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:25.507180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf41adfe-451d-4ba2-856a-b353c28f48ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:25.507740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf41adfe-451d-4ba2-856a-b353c28f48ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:25.508745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf41adfe-451d-4ba2-856a-b353c28f48ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:25.509281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf41adfe-451d-4ba2-856a-b353c28f48ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:25.651730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bf41adfe-451d-4ba2-856a-b353c28f48ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:25.662609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bf41adfe-451d-4ba2-856a-b353c28f48ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1319 microversion: 2.1 time: 0.172410 Feb 21 00:41:25.663359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 269/508] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:25 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:26.373899 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:26.374908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:26.385882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:26.386692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:26.387685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:26.388107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:26.527787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:26.536911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:26.538369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:26.539546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-56bb36be-9b66-4cb0-ae97-713f26792f33 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.172110 Feb 21 00:41:26.540100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 240/509] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:26.682747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-acf648c4-0442-4d78-b6d2-dc0d4fa52be1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:26.683750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-acf648c4-0442-4d78-b6d2-dc0d4fa52be1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:26.694326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acf648c4-0442-4d78-b6d2-dc0d4fa52be1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:26.695063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acf648c4-0442-4d78-b6d2-dc0d4fa52be1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:26.696342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acf648c4-0442-4d78-b6d2-dc0d4fa52be1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:26.697076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acf648c4-0442-4d78-b6d2-dc0d4fa52be1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:26.840629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-acf648c4-0442-4d78-b6d2-dc0d4fa52be1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:26.852661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-acf648c4-0442-4d78-b6d2-dc0d4fa52be1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1319 microversion: 2.1 time: 0.175689 Feb 21 00:41:26.853439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 270/510] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:26 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:27.557527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:27.558125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:27.564974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:27.565412 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:27.566206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:27.566632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:27.712155 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:27.720967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:27.722429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:27.723582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a5d31002-3197-4236-ae0e-631171b57df2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.169867 Feb 21 00:41:27.724133 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 241/511] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:27.874938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-45b532be-874f-4dda-9139-50b0df29a7c7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:27.875792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-45b532be-874f-4dda-9139-50b0df29a7c7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:27.886273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-45b532be-874f-4dda-9139-50b0df29a7c7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:27.887057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-45b532be-874f-4dda-9139-50b0df29a7c7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:27.887820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-45b532be-874f-4dda-9139-50b0df29a7c7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:27.888246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-45b532be-874f-4dda-9139-50b0df29a7c7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:28.046066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-45b532be-874f-4dda-9139-50b0df29a7c7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:28.055792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-45b532be-874f-4dda-9139-50b0df29a7c7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1319 microversion: 2.1 time: 0.186934 Feb 21 00:41:28.056742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 271/512] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:27 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:28.746649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:28.747452 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:28.756270 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:28.756958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:28.758033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:28.758634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:28.903615 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:28.912460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:28.913986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:28.915144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c02ea04a-a79c-4ca9-9b30-14175f1dd11e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.174017 Feb 21 00:41:28.915702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 242/513] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:29.075498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6237b11a-1728-475f-b5f9-a46382aeda20 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:29.076097 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6237b11a-1728-475f-b5f9-a46382aeda20 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:29.086129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6237b11a-1728-475f-b5f9-a46382aeda20 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:29.086574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6237b11a-1728-475f-b5f9-a46382aeda20 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:29.088123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6237b11a-1728-475f-b5f9-a46382aeda20 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:29.088787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6237b11a-1728-475f-b5f9-a46382aeda20 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:29.229754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6237b11a-1728-475f-b5f9-a46382aeda20 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:29.238120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6237b11a-1728-475f-b5f9-a46382aeda20 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1319 microversion: 2.1 time: 0.168465 Feb 21 00:41:29.238697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 272/514] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:29 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:29.934035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:29.934578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:29.941708 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:29.942187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:29.943035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:29.943504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:30.083207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:30.091709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:30.093235 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:30.094391 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-226a3f6c-8bda-4999-9633-d980c7aa7a00 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.164549 Feb 21 00:41:30.094950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 243/515] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:30.254872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a613d03c-004d-4dcc-8c20-fb74715ac3d8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:30.255437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a613d03c-004d-4dcc-8c20-fb74715ac3d8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:30.262374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a613d03c-004d-4dcc-8c20-fb74715ac3d8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:30.262787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a613d03c-004d-4dcc-8c20-fb74715ac3d8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:30.263559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a613d03c-004d-4dcc-8c20-fb74715ac3d8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:30.263988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a613d03c-004d-4dcc-8c20-fb74715ac3d8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:30.414632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a613d03c-004d-4dcc-8c20-fb74715ac3d8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:30.424253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a613d03c-004d-4dcc-8c20-fb74715ac3d8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1319 microversion: 2.1 time: 0.172719 Feb 21 00:41:30.425199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 273/516] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:30 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:31.016684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-55381bbb-7eb1-4170-9c3e-8c6901fd4fe9 req-aeb83622-8796-49ef-aeae-d54974604698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c", "name": "network-vif-plugged", "status": "completed", "tag": "1187a97b-2a24-44bd-8064-9bcc8be5eb03"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:41:31.018254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:41:31.018254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:41:31.026232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-55381bbb-7eb1-4170-9c3e-8c6901fd4fe9 req-aeb83622-8796-49ef-aeae-d54974604698 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:31.026669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-55381bbb-7eb1-4170-9c3e-8c6901fd4fe9 req-aeb83622-8796-49ef-aeae-d54974604698 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:31.037810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-55381bbb-7eb1-4170-9c3e-8c6901fd4fe9 req-aeb83622-8796-49ef-aeae-d54974604698 service nova] Creating event network-vif-plugged:1187a97b-2a24-44bd-8064-9bcc8be5eb03 for instance 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c on hv-cinder-81322 Feb 21 00:41:31.042796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-55381bbb-7eb1-4170-9c3e-8c6901fd4fe9 req-aeb83622-8796-49ef-aeae-d54974604698 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029724 Feb 21 00:41:31.043440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 244/517] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:41:31.112029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:31.112702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:31.118549 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:31.118987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:31.119752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:31.120173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:31.372503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:31.381169 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:31.382701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:31.383856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-38c27790-dae4-404f-91b5-84e3f5245c79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.275799 Feb 21 00:41:31.384416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 274/518] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:31.451800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dc92ac15-53bc-4a3f-9b4b-7f53840f0121 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:31.452989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dc92ac15-53bc-4a3f-9b4b-7f53840f0121 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:31.463328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc92ac15-53bc-4a3f-9b4b-7f53840f0121 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:31.464077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc92ac15-53bc-4a3f-9b4b-7f53840f0121 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:31.465309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc92ac15-53bc-4a3f-9b4b-7f53840f0121 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:31.465741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc92ac15-53bc-4a3f-9b4b-7f53840f0121 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:31.656456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dc92ac15-53bc-4a3f-9b4b-7f53840f0121 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:31.667916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dc92ac15-53bc-4a3f-9b4b-7f53840f0121 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1319 microversion: 2.1 time: 0.222482 Feb 21 00:41:31.668520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 245/519] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:31 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:32.407369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:32.407950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:32.415234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:32.415680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:32.416508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:32.416941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:32.551240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:32.559728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:32.561330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:32.562482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-17c78437-785b-4c48-a07b-5d4c2735d89f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.158940 Feb 21 00:41:32.563047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 275/520] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:32.687654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-82ce30c6-2fda-45d6-aab3-d40b8f3ef956 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:32.688179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-82ce30c6-2fda-45d6-aab3-d40b8f3ef956 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:32.697641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-82ce30c6-2fda-45d6-aab3-d40b8f3ef956 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:32.698220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-82ce30c6-2fda-45d6-aab3-d40b8f3ef956 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:32.699408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-82ce30c6-2fda-45d6-aab3-d40b8f3ef956 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:32.699835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-82ce30c6-2fda-45d6-aab3-d40b8f3ef956 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:32.836092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-82ce30c6-2fda-45d6-aab3-d40b8f3ef956 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:32.843441 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-82ce30c6-2fda-45d6-aab3-d40b8f3ef956 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1319 microversion: 2.1 time: 0.161668 Feb 21 00:41:32.844053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 246/521] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:32 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:33.580528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:33.581190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:33.587773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:33.588211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:33.589014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:33.589434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:33.725002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:33.737790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:33.740102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:33.741861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-370b1a7c-ab30-461f-8c2b-69886b992e64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.164878 Feb 21 00:41:33.742715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 276/522] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:33.863406 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-57694bd9-0b31-4f98-9955-0dcb09bb3ede tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:33.864497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-57694bd9-0b31-4f98-9955-0dcb09bb3ede tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:33.873673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57694bd9-0b31-4f98-9955-0dcb09bb3ede tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:33.874114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57694bd9-0b31-4f98-9955-0dcb09bb3ede tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:33.874875 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57694bd9-0b31-4f98-9955-0dcb09bb3ede tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:33.875299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57694bd9-0b31-4f98-9955-0dcb09bb3ede tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:34.021544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-57694bd9-0b31-4f98-9955-0dcb09bb3ede tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:34.030451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-57694bd9-0b31-4f98-9955-0dcb09bb3ede tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1507 microversion: 2.1 time: 0.173186 Feb 21 00:41:34.031445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 247/523] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:41:33 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:41:34.762129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:34.762783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:34.769256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:34.769700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:34.770488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:34.770952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:34.925424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:34.934826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:34.936311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:34.937718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c950c374-154a-4b31-98d5-7ffdd74c8b64 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.180681 Feb 21 00:41:34.938317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 277/524] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:35.049894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-1f87f047-9371-40c0-ab08-739f5c2faa63 req-66c1855b-ab38-4f44-9803-e6ae453c216e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aa3b9a-864e-42ff-81ec-278e00ddd8be", "name": "network-vif-plugged", "status": "completed", "tag": "d8dbce75-bbb2-4b0b-bc43-c864b59621e9"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:41:35.052175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:41:35.052175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:41:35.061966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-1f87f047-9371-40c0-ab08-739f5c2faa63 req-66c1855b-ab38-4f44-9803-e6ae453c216e service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:35.062480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-1f87f047-9371-40c0-ab08-739f5c2faa63 req-66c1855b-ab38-4f44-9803-e6ae453c216e service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:35.073572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-1f87f047-9371-40c0-ab08-739f5c2faa63 req-66c1855b-ab38-4f44-9803-e6ae453c216e service nova] Creating event network-vif-plugged:d8dbce75-bbb2-4b0b-bc43-c864b59621e9 for instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be on hv-cinder-81322 Feb 21 00:41:35.078470 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-1f87f047-9371-40c0-ab08-739f5c2faa63 req-66c1855b-ab38-4f44-9803-e6ae453c216e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032234 Feb 21 00:41:35.079232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 248/525] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:41:35.955919 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:35.956599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:35.964097 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:35.964724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:35.965497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:35.965922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:36.113231 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:36.122289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:36.123855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:36.125019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6da63756-d6cb-4f45-8d40-7c4fcccc0c31 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.173402 Feb 21 00:41:36.125580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 278/526] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:35 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:37.143751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:37.144498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:37.151496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:37.151944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:37.152754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:37.153352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:37.296591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:37.305979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:37.307459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:37.308780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-986bd3f8-c194-4555-b372-c3606bc3358a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1809 microversion: 2.20 time: 0.169223 Feb 21 00:41:37.309341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 249/527] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:37 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:38.326825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:41:38.327421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:38.334795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:38.335244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:38.336101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:38.336678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:38.711919 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:38.720153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:38.721661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:41:38.722876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-198c7c09-b054-4231-8e71-b91cee66713a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1796 microversion: 2.20 time: 0.399866 Feb 21 00:41:38.723443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 279/528] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 00:41:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1796 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 00:41:39.626818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:41:39.627416 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 00:41:57.606831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2500a393-e446-4cae-b046-d4836469774e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeaff174-0ced-476f-a5b2-f4bcf3867e09", "device": "/dev/sdb"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:41:57.608614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2500a393-e446-4cae-b046-d4836469774e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:41:57.615842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2500a393-e446-4cae-b046-d4836469774e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:57.616283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2500a393-e446-4cae-b046-d4836469774e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:57.617088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2500a393-e446-4cae-b046-d4836469774e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:41:57.617511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2500a393-e446-4cae-b046-d4836469774e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:41:57.878790 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2500a393-e446-4cae-b046-d4836469774e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "POST /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275635 Feb 21 00:41:57.879607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 250/529] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 00:41:57 2022] POST /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:42:11.124768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-378ab34e-d377-4065-8605-2b576bb82235 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:11.125281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-378ab34e-d377-4065-8605-2b576bb82235 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:11.131471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378ab34e-d377-4065-8605-2b576bb82235 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:11.131907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378ab34e-d377-4065-8605-2b576bb82235 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:11.132700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378ab34e-d377-4065-8605-2b576bb82235 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:11.133123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378ab34e-d377-4065-8605-2b576bb82235 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:11.210760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-378ab34e-d377-4065-8605-2b576bb82235 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lazy-loading 'services' on Instance uuid 2482a368-86ed-4e3c-aa3d-e414ae527066 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:42:11.332590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-378ab34e-d377-4065-8605-2b576bb82235 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments/5bdfc425-3634-403f-82cf-5ec28d270475" status: 202 len: 0 microversion: 2.1 time: 0.325693 Feb 21 00:42:11.333173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 280/530] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:42:11 2022] DELETE /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments/5bdfc425-3634-403f-82cf-5ec28d270475 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:42:16.674514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-475858f6-ad30-455c-a92c-550ebf4d4bbb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:42:16.681535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-475858f6-ad30-455c-a92c-550ebf4d4bbb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:16.681980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-475858f6-ad30-455c-a92c-550ebf4d4bbb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:16.704008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-475858f6-ad30-455c-a92c-550ebf4d4bbb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Going to try to stop instance {{(pid=123097) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 00:42:16.748880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-475858f6-ad30-455c-a92c-550ebf4d4bbb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/action" status: 202 len: 0 microversion: 2.1 time: 0.078459 Feb 21 00:42:16.749457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 251/531] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:42:16 2022] POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:42:16.758646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1b439820-08ed-4876-b466-6ecf6c02d529 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:16.759364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1b439820-08ed-4876-b466-6ecf6c02d529 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:16.766257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b439820-08ed-4876-b466-6ecf6c02d529 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:16.766746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b439820-08ed-4876-b466-6ecf6c02d529 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:16.767650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b439820-08ed-4876-b466-6ecf6c02d529 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:16.768117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b439820-08ed-4876-b466-6ecf6c02d529 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:16.901550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1b439820-08ed-4876-b466-6ecf6c02d529 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:16.909314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1b439820-08ed-4876-b466-6ecf6c02d529 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.155293 Feb 21 00:42:16.909886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 281/532] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:16 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:17.932609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d92a3d93-ef30-4ee0-9492-0801f1482382 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:17.933482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d92a3d93-ef30-4ee0-9492-0801f1482382 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:17.941206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d92a3d93-ef30-4ee0-9492-0801f1482382 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:17.941652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d92a3d93-ef30-4ee0-9492-0801f1482382 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:17.942424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d92a3d93-ef30-4ee0-9492-0801f1482382 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:17.942855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d92a3d93-ef30-4ee0-9492-0801f1482382 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:18.081988 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d92a3d93-ef30-4ee0-9492-0801f1482382 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:18.093323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d92a3d93-ef30-4ee0-9492-0801f1482382 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.168426 Feb 21 00:42:18.094100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 252/533] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:17 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:19.115131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e2c9fae1-8bf8-4b59-b78d-b853271a8be2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:19.116072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e2c9fae1-8bf8-4b59-b78d-b853271a8be2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:19.126584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2c9fae1-8bf8-4b59-b78d-b853271a8be2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:19.127310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2c9fae1-8bf8-4b59-b78d-b853271a8be2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:19.128616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2c9fae1-8bf8-4b59-b78d-b853271a8be2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:19.129323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2c9fae1-8bf8-4b59-b78d-b853271a8be2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:19.283118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e2c9fae1-8bf8-4b59-b78d-b853271a8be2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:19.291210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e2c9fae1-8bf8-4b59-b78d-b853271a8be2 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.182238 Feb 21 00:42:19.291780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 282/534] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:19 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:20.312102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ea887d24-00ea-43b6-82b6-d42ab2ef4d0e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:20.313194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ea887d24-00ea-43b6-82b6-d42ab2ef4d0e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:20.323752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ea887d24-00ea-43b6-82b6-d42ab2ef4d0e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:20.324500 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ea887d24-00ea-43b6-82b6-d42ab2ef4d0e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:20.325781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ea887d24-00ea-43b6-82b6-d42ab2ef4d0e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:20.326594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ea887d24-00ea-43b6-82b6-d42ab2ef4d0e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:20.465398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ea887d24-00ea-43b6-82b6-d42ab2ef4d0e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:20.477012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ea887d24-00ea-43b6-82b6-d42ab2ef4d0e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.170648 Feb 21 00:42:20.477878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 253/535] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:20 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:21.499466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-98d4cc0a-b32b-4f8b-881c-5de574b073b1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:21.500442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-98d4cc0a-b32b-4f8b-881c-5de574b073b1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:21.511867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98d4cc0a-b32b-4f8b-881c-5de574b073b1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:21.512699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98d4cc0a-b32b-4f8b-881c-5de574b073b1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:21.514154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98d4cc0a-b32b-4f8b-881c-5de574b073b1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:21.514871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98d4cc0a-b32b-4f8b-881c-5de574b073b1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:21.652724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-98d4cc0a-b32b-4f8b-881c-5de574b073b1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:21.660714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-98d4cc0a-b32b-4f8b-881c-5de574b073b1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.167534 Feb 21 00:42:21.661292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 283/536] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:21 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:22.681634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6f5b637a-a756-4fab-9082-ad54c496b106 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:22.682452 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6f5b637a-a756-4fab-9082-ad54c496b106 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:22.693259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f5b637a-a756-4fab-9082-ad54c496b106 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:22.694005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f5b637a-a756-4fab-9082-ad54c496b106 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:22.695283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f5b637a-a756-4fab-9082-ad54c496b106 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:22.696069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f5b637a-a756-4fab-9082-ad54c496b106 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:22.834368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6f5b637a-a756-4fab-9082-ad54c496b106 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:22.843731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6f5b637a-a756-4fab-9082-ad54c496b106 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.168467 Feb 21 00:42:22.844263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 254/537] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:22 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:23.864650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2942a24d-9c06-49a3-a93a-efbcb54be02a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:23.865685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2942a24d-9c06-49a3-a93a-efbcb54be02a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:23.875340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2942a24d-9c06-49a3-a93a-efbcb54be02a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:23.875775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2942a24d-9c06-49a3-a93a-efbcb54be02a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:23.876578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2942a24d-9c06-49a3-a93a-efbcb54be02a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:23.876998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2942a24d-9c06-49a3-a93a-efbcb54be02a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:24.028340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2942a24d-9c06-49a3-a93a-efbcb54be02a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:24.039529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2942a24d-9c06-49a3-a93a-efbcb54be02a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.180891 Feb 21 00:42:24.040327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 284/538] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:23 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:25.021890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8ee9ed69-a099-4052-acc1-e95727a17828 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:42:25.023597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8ee9ed69-a099-4052-acc1-e95727a17828 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:25.034650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ee9ed69-a099-4052-acc1-e95727a17828 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:25.035384 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ee9ed69-a099-4052-acc1-e95727a17828 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:25.036755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ee9ed69-a099-4052-acc1-e95727a17828 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:25.037477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ee9ed69-a099-4052-acc1-e95727a17828 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:25.057232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-257f8b9b-c2d3-400d-93f4-0e2e9b235460 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:25.057754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-257f8b9b-c2d3-400d-93f4-0e2e9b235460 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:25.065199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-257f8b9b-c2d3-400d-93f4-0e2e9b235460 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:25.065838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-257f8b9b-c2d3-400d-93f4-0e2e9b235460 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:25.067127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-257f8b9b-c2d3-400d-93f4-0e2e9b235460 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:25.067897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-257f8b9b-c2d3-400d-93f4-0e2e9b235460 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:25.116063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8ee9ed69-a099-4052-acc1-e95727a17828 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "POST /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/action" status: 202 len: 0 microversion: 2.1 time: 0.100294 Feb 21 00:42:25.116804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 255/539] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:42:25 2022] POST /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:42:25.124902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d9602024-4edf-486f-a7c0-b33cc2c0101a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:25.125586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d9602024-4edf-486f-a7c0-b33cc2c0101a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:25.131879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d9602024-4edf-486f-a7c0-b33cc2c0101a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:25.132430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d9602024-4edf-486f-a7c0-b33cc2c0101a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:25.133209 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d9602024-4edf-486f-a7c0-b33cc2c0101a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:25.133633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d9602024-4edf-486f-a7c0-b33cc2c0101a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:25.218667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-257f8b9b-c2d3-400d-93f4-0e2e9b235460 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:25.226080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-257f8b9b-c2d3-400d-93f4-0e2e9b235460 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.172606 Feb 21 00:42:25.226652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 285/540] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:25 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:25.285979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d9602024-4edf-486f-a7c0-b33cc2c0101a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:25.293892 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d9602024-4edf-486f-a7c0-b33cc2c0101a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1750 microversion: 2.1 time: 0.172750 Feb 21 00:42:25.294447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 256/541] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:25 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:26.247116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-63b06374-722d-4ad1-aa9a-0ae0b4047fb4 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:26.248120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-63b06374-722d-4ad1-aa9a-0ae0b4047fb4 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:26.258814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-63b06374-722d-4ad1-aa9a-0ae0b4047fb4 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:26.259545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-63b06374-722d-4ad1-aa9a-0ae0b4047fb4 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:26.260867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-63b06374-722d-4ad1-aa9a-0ae0b4047fb4 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:26.261576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-63b06374-722d-4ad1-aa9a-0ae0b4047fb4 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:26.310944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3e0668dc-02f0-4d7b-9af3-60fadd012966 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:26.311550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3e0668dc-02f0-4d7b-9af3-60fadd012966 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:26.318273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e0668dc-02f0-4d7b-9af3-60fadd012966 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:26.318711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e0668dc-02f0-4d7b-9af3-60fadd012966 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:26.319486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e0668dc-02f0-4d7b-9af3-60fadd012966 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:26.319945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e0668dc-02f0-4d7b-9af3-60fadd012966 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:26.405538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-63b06374-722d-4ad1-aa9a-0ae0b4047fb4 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:26.413573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-63b06374-722d-4ad1-aa9a-0ae0b4047fb4 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.172742 Feb 21 00:42:26.414160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 286/542] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:26 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:26.481685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3e0668dc-02f0-4d7b-9af3-60fadd012966 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:26.489992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3e0668dc-02f0-4d7b-9af3-60fadd012966 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.182768 Feb 21 00:42:26.490530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 257/543] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:26 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:27.434909 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4271e007-0c99-432d-933d-81bae3291368 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:27.435901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4271e007-0c99-432d-933d-81bae3291368 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:27.442936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4271e007-0c99-432d-933d-81bae3291368 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:27.443385 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4271e007-0c99-432d-933d-81bae3291368 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:27.444159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4271e007-0c99-432d-933d-81bae3291368 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:27.444633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4271e007-0c99-432d-933d-81bae3291368 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:27.507355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-27407474-84c8-49c4-bce0-8f47552898ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:27.507986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-27407474-84c8-49c4-bce0-8f47552898ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:27.514676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-27407474-84c8-49c4-bce0-8f47552898ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:27.515124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-27407474-84c8-49c4-bce0-8f47552898ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:27.515900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-27407474-84c8-49c4-bce0-8f47552898ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:27.516325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-27407474-84c8-49c4-bce0-8f47552898ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:27.586715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4271e007-0c99-432d-933d-81bae3291368 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:27.594375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4271e007-0c99-432d-933d-81bae3291368 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.166337 Feb 21 00:42:27.594963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 287/544] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:27 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:27.660548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-27407474-84c8-49c4-bce0-8f47552898ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:27.668419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-27407474-84c8-49c4-bce0-8f47552898ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.165143 Feb 21 00:42:27.669007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 258/545] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:27 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:42:28.612786 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3929798b-de0b-45a0-a669-071fba388584 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:28.613408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3929798b-de0b-45a0-a669-071fba388584 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:28.619760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3929798b-de0b-45a0-a669-071fba388584 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:28.620220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3929798b-de0b-45a0-a669-071fba388584 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:28.621033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3929798b-de0b-45a0-a669-071fba388584 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:28.621459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3929798b-de0b-45a0-a669-071fba388584 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:28.686680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-68d47951-47ef-4e48-8a63-48c9800815cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:28.688086 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-68d47951-47ef-4e48-8a63-48c9800815cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:28.695007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68d47951-47ef-4e48-8a63-48c9800815cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:28.695696 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68d47951-47ef-4e48-8a63-48c9800815cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:28.696496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68d47951-47ef-4e48-8a63-48c9800815cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:28.696947 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68d47951-47ef-4e48-8a63-48c9800815cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:28.755650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3929798b-de0b-45a0-a669-071fba388584 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:28.763315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3929798b-de0b-45a0-a669-071fba388584 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.154417 Feb 21 00:42:28.763900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 288/546] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:28 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:28.844517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-68d47951-47ef-4e48-8a63-48c9800815cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:28.852483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-68d47951-47ef-4e48-8a63-48c9800815cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.169431 Feb 21 00:42:28.853058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 259/547] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:28 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:29.781299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dd81c238-5d60-43b6-8ae3-3c7cc2a82c47 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:29.782442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dd81c238-5d60-43b6-8ae3-3c7cc2a82c47 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:29.792179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd81c238-5d60-43b6-8ae3-3c7cc2a82c47 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:29.792842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd81c238-5d60-43b6-8ae3-3c7cc2a82c47 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:29.793945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd81c238-5d60-43b6-8ae3-3c7cc2a82c47 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:29.794581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd81c238-5d60-43b6-8ae3-3c7cc2a82c47 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:29.873180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-19544e93-18f0-4e26-b861-72c20f99a1cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:29.874119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-19544e93-18f0-4e26-b861-72c20f99a1cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:29.880928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19544e93-18f0-4e26-b861-72c20f99a1cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:29.881377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19544e93-18f0-4e26-b861-72c20f99a1cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:29.882184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19544e93-18f0-4e26-b861-72c20f99a1cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:29.882610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19544e93-18f0-4e26-b861-72c20f99a1cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:29.942929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dd81c238-5d60-43b6-8ae3-3c7cc2a82c47 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:29.950336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dd81c238-5d60-43b6-8ae3-3c7cc2a82c47 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.173160 Feb 21 00:42:29.950901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 289/548] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:29 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:30.039058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19544e93-18f0-4e26-b861-72c20f99a1cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:30.049691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-19544e93-18f0-4e26-b861-72c20f99a1cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.181897 Feb 21 00:42:30.050251 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 260/549] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:29 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:30.968310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6b805522-fc2f-4dd4-a0b0-3a2ebcf4f5e1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:30.969079 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6b805522-fc2f-4dd4-a0b0-3a2ebcf4f5e1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:30.976575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b805522-fc2f-4dd4-a0b0-3a2ebcf4f5e1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:30.977056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b805522-fc2f-4dd4-a0b0-3a2ebcf4f5e1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:30.977921 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b805522-fc2f-4dd4-a0b0-3a2ebcf4f5e1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:30.978400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b805522-fc2f-4dd4-a0b0-3a2ebcf4f5e1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:31.067236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b74be6bd-6bc5-4fb2-81a8-12fce946a607 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:31.067854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b74be6bd-6bc5-4fb2-81a8-12fce946a607 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:31.074406 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b74be6bd-6bc5-4fb2-81a8-12fce946a607 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:31.074844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b74be6bd-6bc5-4fb2-81a8-12fce946a607 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:31.075612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b74be6bd-6bc5-4fb2-81a8-12fce946a607 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:31.076033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b74be6bd-6bc5-4fb2-81a8-12fce946a607 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:31.113507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6b805522-fc2f-4dd4-a0b0-3a2ebcf4f5e1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:31.121043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6b805522-fc2f-4dd4-a0b0-3a2ebcf4f5e1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.157254 Feb 21 00:42:31.121623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 290/550] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:30 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:31.222077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b74be6bd-6bc5-4fb2-81a8-12fce946a607 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:31.230291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b74be6bd-6bc5-4fb2-81a8-12fce946a607 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.166763 Feb 21 00:42:31.230867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 261/551] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:31 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:32.141834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4ec532ec-bb1c-454b-828d-9756b4dadb5f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:32.142910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4ec532ec-bb1c-454b-828d-9756b4dadb5f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:32.153668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ec532ec-bb1c-454b-828d-9756b4dadb5f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:32.154402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ec532ec-bb1c-454b-828d-9756b4dadb5f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:32.155560 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ec532ec-bb1c-454b-828d-9756b4dadb5f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:32.155984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ec532ec-bb1c-454b-828d-9756b4dadb5f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:32.248733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-61cfe54a-ecd5-40a8-81d2-b8481eb26300 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:32.249324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-61cfe54a-ecd5-40a8-81d2-b8481eb26300 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:32.256175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-61cfe54a-ecd5-40a8-81d2-b8481eb26300 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:32.256666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-61cfe54a-ecd5-40a8-81d2-b8481eb26300 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:32.257447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-61cfe54a-ecd5-40a8-81d2-b8481eb26300 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:32.257873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-61cfe54a-ecd5-40a8-81d2-b8481eb26300 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:32.304071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4ec532ec-bb1c-454b-828d-9756b4dadb5f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:32.311689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4ec532ec-bb1c-454b-828d-9756b4dadb5f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.175987 Feb 21 00:42:32.312252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 291/552] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:32 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:32.403818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-61cfe54a-ecd5-40a8-81d2-b8481eb26300 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:32.414857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-61cfe54a-ecd5-40a8-81d2-b8481eb26300 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.169476 Feb 21 00:42:32.415608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 262/553] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:32 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:33.330425 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b70929b9-2d6c-45ba-a5d5-a03c93f5f84a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:33.331177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b70929b9-2d6c-45ba-a5d5-a03c93f5f84a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:33.339476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b70929b9-2d6c-45ba-a5d5-a03c93f5f84a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:33.340021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b70929b9-2d6c-45ba-a5d5-a03c93f5f84a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:33.341003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b70929b9-2d6c-45ba-a5d5-a03c93f5f84a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:33.341537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b70929b9-2d6c-45ba-a5d5-a03c93f5f84a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:33.436933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a9aa9866-6c4b-4729-bebe-603a297fd869 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:33.437938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a9aa9866-6c4b-4729-bebe-603a297fd869 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:33.443921 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a9aa9866-6c4b-4729-bebe-603a297fd869 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:33.444336 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a9aa9866-6c4b-4729-bebe-603a297fd869 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:33.445109 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a9aa9866-6c4b-4729-bebe-603a297fd869 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:33.445568 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a9aa9866-6c4b-4729-bebe-603a297fd869 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:33.489767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b70929b9-2d6c-45ba-a5d5-a03c93f5f84a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:33.497472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b70929b9-2d6c-45ba-a5d5-a03c93f5f84a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.171877 Feb 21 00:42:33.498001 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 292/554] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:33 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:33.605339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a9aa9866-6c4b-4729-bebe-603a297fd869 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:33.616583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a9aa9866-6c4b-4729-bebe-603a297fd869 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.185257 Feb 21 00:42:33.617538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 263/555] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:33 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:34.518377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ccbd6dc2-781a-454b-929c-4c5b58e93a63 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:34.518979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ccbd6dc2-781a-454b-929c-4c5b58e93a63 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:34.525416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccbd6dc2-781a-454b-929c-4c5b58e93a63 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:34.525856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccbd6dc2-781a-454b-929c-4c5b58e93a63 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:34.526631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccbd6dc2-781a-454b-929c-4c5b58e93a63 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:34.527055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccbd6dc2-781a-454b-929c-4c5b58e93a63 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:34.634070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f738db23-1f41-4568-8655-f904e5fc9433 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:34.634624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f738db23-1f41-4568-8655-f904e5fc9433 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:34.641406 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f738db23-1f41-4568-8655-f904e5fc9433 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:34.641847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f738db23-1f41-4568-8655-f904e5fc9433 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:34.642616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f738db23-1f41-4568-8655-f904e5fc9433 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:34.643038 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f738db23-1f41-4568-8655-f904e5fc9433 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:34.661380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ccbd6dc2-781a-454b-929c-4c5b58e93a63 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:34.670150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ccbd6dc2-781a-454b-929c-4c5b58e93a63 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.157556 Feb 21 00:42:34.670732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 293/556] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:34 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:35.011684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f738db23-1f41-4568-8655-f904e5fc9433 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:35.023516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f738db23-1f41-4568-8655-f904e5fc9433 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.392749 Feb 21 00:42:35.024255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 264/557] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:34 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:35.689739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bd71294d-f699-4025-a5a5-9a9121d250aa tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:35.690370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bd71294d-f699-4025-a5a5-9a9121d250aa tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:35.697175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd71294d-f699-4025-a5a5-9a9121d250aa tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:35.697614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd71294d-f699-4025-a5a5-9a9121d250aa tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:35.698386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd71294d-f699-4025-a5a5-9a9121d250aa tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:35.698810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd71294d-f699-4025-a5a5-9a9121d250aa tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:35.842430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bd71294d-f699-4025-a5a5-9a9121d250aa tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:35.850033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bd71294d-f699-4025-a5a5-9a9121d250aa tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.164796 Feb 21 00:42:35.850586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 294/558] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:35 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:36.047326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3e566d5c-2302-47ee-825c-baad79e35e2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:36.047884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3e566d5c-2302-47ee-825c-baad79e35e2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:36.054723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e566d5c-2302-47ee-825c-baad79e35e2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:36.055166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e566d5c-2302-47ee-825c-baad79e35e2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:36.055932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e566d5c-2302-47ee-825c-baad79e35e2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:36.056357 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e566d5c-2302-47ee-825c-baad79e35e2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:36.215389 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3e566d5c-2302-47ee-825c-baad79e35e2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:36.223387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3e566d5c-2302-47ee-825c-baad79e35e2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.181687 Feb 21 00:42:36.223966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 265/559] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:36 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:36.866774 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ad786783-5c40-41e1-8cbf-c11561094086 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:36.867493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ad786783-5c40-41e1-8cbf-c11561094086 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:36.874477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad786783-5c40-41e1-8cbf-c11561094086 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:36.875032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad786783-5c40-41e1-8cbf-c11561094086 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:36.875823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad786783-5c40-41e1-8cbf-c11561094086 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:36.876291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad786783-5c40-41e1-8cbf-c11561094086 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:37.014803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ad786783-5c40-41e1-8cbf-c11561094086 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:37.022451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ad786783-5c40-41e1-8cbf-c11561094086 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1674 microversion: 2.1 time: 0.159319 Feb 21 00:42:37.022991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 295/560] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:36 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:37.242140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e84d0735-0d74-4e42-ad82-5e473bb3c6bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:37.242733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e84d0735-0d74-4e42-ad82-5e473bb3c6bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:37.249074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e84d0735-0d74-4e42-ad82-5e473bb3c6bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:37.249681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e84d0735-0d74-4e42-ad82-5e473bb3c6bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:37.250462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e84d0735-0d74-4e42-ad82-5e473bb3c6bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:37.250894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e84d0735-0d74-4e42-ad82-5e473bb3c6bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:37.401868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e84d0735-0d74-4e42-ad82-5e473bb3c6bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:37.411503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e84d0735-0d74-4e42-ad82-5e473bb3c6bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.174598 Feb 21 00:42:37.412085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 266/561] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:37 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:38.043670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8c308cd8-d984-493e-8fca-282e71057cac tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:38.044744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8c308cd8-d984-493e-8fca-282e71057cac tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:38.055280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c308cd8-d984-493e-8fca-282e71057cac tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:38.056026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c308cd8-d984-493e-8fca-282e71057cac tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:38.057367 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c308cd8-d984-493e-8fca-282e71057cac tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:38.058090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c308cd8-d984-493e-8fca-282e71057cac tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:38.192239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8c308cd8-d984-493e-8fca-282e71057cac tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:38.199660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8c308cd8-d984-493e-8fca-282e71057cac tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1651 microversion: 2.1 time: 0.162302 Feb 21 00:42:38.200334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 296/562] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:38 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1651 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:38.215801 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d5511fd3-be75-49a8-8d2f-5521b53dd271 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:42:38.222292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5511fd3-be75-49a8-8d2f-5521b53dd271 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:38.222729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5511fd3-be75-49a8-8d2f-5521b53dd271 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:38.244057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d5511fd3-be75-49a8-8d2f-5521b53dd271 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Going to try to start instance {{(pid=123097) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 00:42:38.289689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d5511fd3-be75-49a8-8d2f-5521b53dd271 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/action" status: 202 len: 0 microversion: 2.1 time: 0.077384 Feb 21 00:42:38.290270 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 267/563] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:42:38 2022] POST /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 00:42:38.299570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-62227941-2e7c-454e-b56a-c10536213c36 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:38.300168 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-62227941-2e7c-454e-b56a-c10536213c36 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:38.305886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-62227941-2e7c-454e-b56a-c10536213c36 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:38.306315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-62227941-2e7c-454e-b56a-c10536213c36 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:38.307080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-62227941-2e7c-454e-b56a-c10536213c36 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:38.307545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-62227941-2e7c-454e-b56a-c10536213c36 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:38.429613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b1bbfa61-64e8-47b2-9e48-62c807728548 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:38.430454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b1bbfa61-64e8-47b2-9e48-62c807728548 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:38.437050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1bbfa61-64e8-47b2-9e48-62c807728548 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:38.437528 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1bbfa61-64e8-47b2-9e48-62c807728548 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:38.438301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1bbfa61-64e8-47b2-9e48-62c807728548 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:38.438725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1bbfa61-64e8-47b2-9e48-62c807728548 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:38.486378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-62227941-2e7c-454e-b56a-c10536213c36 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:38.493784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-62227941-2e7c-454e-b56a-c10536213c36 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1660 microversion: 2.1 time: 0.197815 Feb 21 00:42:38.494354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 297/564] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:38 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1660 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:38.595943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b1bbfa61-64e8-47b2-9e48-62c807728548 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:38.603874 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b1bbfa61-64e8-47b2-9e48-62c807728548 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.178597 Feb 21 00:42:38.604451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 268/565] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:38 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:39.510314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-173f359c-340f-4320-ac3e-8d36b2346515 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:39.510908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-173f359c-340f-4320-ac3e-8d36b2346515 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:39.517235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-173f359c-340f-4320-ac3e-8d36b2346515 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:39.517678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-173f359c-340f-4320-ac3e-8d36b2346515 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:39.518471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-173f359c-340f-4320-ac3e-8d36b2346515 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:39.518897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-173f359c-340f-4320-ac3e-8d36b2346515 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:39.620613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-effe8bcc-9909-40de-98d8-8a16cc627e1f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:39.621365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-effe8bcc-9909-40de-98d8-8a16cc627e1f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:39.628161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-effe8bcc-9909-40de-98d8-8a16cc627e1f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:39.628727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-effe8bcc-9909-40de-98d8-8a16cc627e1f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:39.629571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-effe8bcc-9909-40de-98d8-8a16cc627e1f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:39.630061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-effe8bcc-9909-40de-98d8-8a16cc627e1f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:39.660466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-173f359c-340f-4320-ac3e-8d36b2346515 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:39.668017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-173f359c-340f-4320-ac3e-8d36b2346515 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1660 microversion: 2.1 time: 0.161515 Feb 21 00:42:39.668613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 298/566] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:39 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1660 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:39.775973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-effe8bcc-9909-40de-98d8-8a16cc627e1f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:39.785011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-effe8bcc-9909-40de-98d8-8a16cc627e1f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.168198 Feb 21 00:42:39.785581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 269/567] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:39 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:42:40.688135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cc2a2c0d-1448-4dfa-82e8-ba3d56b61daf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:40.689204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cc2a2c0d-1448-4dfa-82e8-ba3d56b61daf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:40.699651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc2a2c0d-1448-4dfa-82e8-ba3d56b61daf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:40.700433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc2a2c0d-1448-4dfa-82e8-ba3d56b61daf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:40.701689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc2a2c0d-1448-4dfa-82e8-ba3d56b61daf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:40.702505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc2a2c0d-1448-4dfa-82e8-ba3d56b61daf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:40.802050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-97afcecf-5a5f-4c63-bfe5-fafd8d2c528f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:40.802760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-97afcecf-5a5f-4c63-bfe5-fafd8d2c528f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:40.809341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97afcecf-5a5f-4c63-bfe5-fafd8d2c528f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:40.809791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97afcecf-5a5f-4c63-bfe5-fafd8d2c528f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:40.810554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97afcecf-5a5f-4c63-bfe5-fafd8d2c528f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:40.810977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97afcecf-5a5f-4c63-bfe5-fafd8d2c528f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:40.840745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cc2a2c0d-1448-4dfa-82e8-ba3d56b61daf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:40.848646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cc2a2c0d-1448-4dfa-82e8-ba3d56b61daf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1664 microversion: 2.1 time: 0.166561 Feb 21 00:42:40.849199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 299/568] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:40 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:40.958477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-97afcecf-5a5f-4c63-bfe5-fafd8d2c528f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:40.966713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-97afcecf-5a5f-4c63-bfe5-fafd8d2c528f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1755 microversion: 2.1 time: 0.168319 Feb 21 00:42:40.967285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 270/569] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:40 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:41.986949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b2f13506-c4eb-44d3-b705-20e29716b9d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:41.987621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b2f13506-c4eb-44d3-b705-20e29716b9d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:41.995396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b2f13506-c4eb-44d3-b705-20e29716b9d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:41.995915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b2f13506-c4eb-44d3-b705-20e29716b9d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:41.996872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b2f13506-c4eb-44d3-b705-20e29716b9d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:41.997370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b2f13506-c4eb-44d3-b705-20e29716b9d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:42.154596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b2f13506-c4eb-44d3-b705-20e29716b9d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:42:42.162739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b2f13506-c4eb-44d3-b705-20e29716b9d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1758 microversion: 2.1 time: 0.181079 Feb 21 00:42:42.163299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 300/570] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:42:41 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:42:58.726950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d6de34ca-ae57-4213-afb3-03086b41bbee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:58.727471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d6de34ca-ae57-4213-afb3-03086b41bbee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:58.733796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d6de34ca-ae57-4213-afb3-03086b41bbee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:58.734236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d6de34ca-ae57-4213-afb3-03086b41bbee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:58.735003 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d6de34ca-ae57-4213-afb3-03086b41bbee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:58.735432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d6de34ca-ae57-4213-afb3-03086b41bbee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:58.763656 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d6de34ca-ae57-4213-afb3-03086b41bbee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments/e7a814c9-9d04-498c-97fa-0a1547d5b0a6" status: 200 len: 194 microversion: 2.20 time: 0.143822 Feb 21 00:42:58.764293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 271/571] 10.222.0.72 () {60 vars in 1453 bytes} [Mon Feb 21 00:42:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments/e7a814c9-9d04-498c-97fa-0a1547d5b0a6 => generated 194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:42:58.823293 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b13e1023-2e52-43db-b55a-5ab983afb7fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:58.823809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b13e1023-2e52-43db-b55a-5ab983afb7fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:58.830123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b13e1023-2e52-43db-b55a-5ab983afb7fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:58.830598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b13e1023-2e52-43db-b55a-5ab983afb7fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:58.831364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b13e1023-2e52-43db-b55a-5ab983afb7fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:58.831789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b13e1023-2e52-43db-b55a-5ab983afb7fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:58.913412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-b13e1023-2e52-43db-b55a-5ab983afb7fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lazy-loading 'services' on Instance uuid f5aa3b9a-864e-42ff-81ec-278e00ddd8be {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:42:58.989491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b13e1023-2e52-43db-b55a-5ab983afb7fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments/e7a814c9-9d04-498c-97fa-0a1547d5b0a6" status: 202 len: 0 microversion: 2.20 time: 0.169789 Feb 21 00:42:58.990106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 301/572] 10.222.0.72 () {60 vars in 1456 bytes} [Mon Feb 21 00:42:58 2022] DELETE /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments/e7a814c9-9d04-498c-97fa-0a1547d5b0a6 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:42:59.000096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ee2f906-d5ea-4d4a-b775-d80b163b1449 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:42:59.001135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6ee2f906-d5ea-4d4a-b775-d80b163b1449 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:42:59.007548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ee2f906-d5ea-4d4a-b775-d80b163b1449 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:59.008152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ee2f906-d5ea-4d4a-b775-d80b163b1449 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:59.008794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ee2f906-d5ea-4d4a-b775-d80b163b1449 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:42:59.009221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ee2f906-d5ea-4d4a-b775-d80b163b1449 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:42:59.040007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ee2f906-d5ea-4d4a-b775-d80b163b1449 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043179 Feb 21 00:42:59.043936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 272/573] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:42:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:00.053451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5cad9094-a678-4244-891f-d83b6054c740 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:00.054484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5cad9094-a678-4244-891f-d83b6054c740 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:00.061612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5cad9094-a678-4244-891f-d83b6054c740 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:00.062051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5cad9094-a678-4244-891f-d83b6054c740 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:00.062818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5cad9094-a678-4244-891f-d83b6054c740 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:00.063242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5cad9094-a678-4244-891f-d83b6054c740 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:00.093050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5cad9094-a678-4244-891f-d83b6054c740 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043916 Feb 21 00:43:00.093600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 302/574] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:00 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:01.108901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-92795fb6-3028-46ef-9688-1e8053a03e27 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:01.110369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-92795fb6-3028-46ef-9688-1e8053a03e27 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:01.121079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-92795fb6-3028-46ef-9688-1e8053a03e27 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:01.121817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-92795fb6-3028-46ef-9688-1e8053a03e27 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:01.123120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-92795fb6-3028-46ef-9688-1e8053a03e27 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:01.123744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-92795fb6-3028-46ef-9688-1e8053a03e27 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:01.154325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-92795fb6-3028-46ef-9688-1e8053a03e27 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051870 Feb 21 00:43:01.154982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 273/575] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:02.170740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d767ddc5-d415-467a-84f2-7957cbda7f39 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:02.172292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d767ddc5-d415-467a-84f2-7957cbda7f39 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:02.182751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d767ddc5-d415-467a-84f2-7957cbda7f39 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:02.183483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d767ddc5-d415-467a-84f2-7957cbda7f39 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:02.184815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d767ddc5-d415-467a-84f2-7957cbda7f39 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:02.185521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d767ddc5-d415-467a-84f2-7957cbda7f39 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:02.214321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d767ddc5-d415-467a-84f2-7957cbda7f39 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050035 Feb 21 00:43:02.214826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 303/576] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:03.229680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0e4f7995-9915-49e5-a5cd-8b4a91bd1f3e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:03.231145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0e4f7995-9915-49e5-a5cd-8b4a91bd1f3e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:03.238337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0e4f7995-9915-49e5-a5cd-8b4a91bd1f3e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:03.238784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0e4f7995-9915-49e5-a5cd-8b4a91bd1f3e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:03.239555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0e4f7995-9915-49e5-a5cd-8b4a91bd1f3e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:03.239982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0e4f7995-9915-49e5-a5cd-8b4a91bd1f3e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:03.269231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0e4f7995-9915-49e5-a5cd-8b4a91bd1f3e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046217 Feb 21 00:43:03.269870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 274/577] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:04.286123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-17125ced-d10c-4ae0-ae7d-947a13f82d3a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:04.287618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-17125ced-d10c-4ae0-ae7d-947a13f82d3a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:04.299731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17125ced-d10c-4ae0-ae7d-947a13f82d3a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:04.300776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17125ced-d10c-4ae0-ae7d-947a13f82d3a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:04.302190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17125ced-d10c-4ae0-ae7d-947a13f82d3a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:04.304365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17125ced-d10c-4ae0-ae7d-947a13f82d3a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:04.336714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-17125ced-d10c-4ae0-ae7d-947a13f82d3a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057466 Feb 21 00:43:04.337522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 304/578] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:05.352793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-739536c9-1c14-42e3-b75c-d0acd2231e52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:05.354294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-739536c9-1c14-42e3-b75c-d0acd2231e52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:05.362257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-739536c9-1c14-42e3-b75c-d0acd2231e52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:05.362707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-739536c9-1c14-42e3-b75c-d0acd2231e52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:05.363493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-739536c9-1c14-42e3-b75c-d0acd2231e52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:05.363928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-739536c9-1c14-42e3-b75c-d0acd2231e52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:05.393649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-739536c9-1c14-42e3-b75c-d0acd2231e52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047219 Feb 21 00:43:05.394211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 275/579] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:06.409089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-aa5cef07-a11b-4df1-8af8-6eccff69d80f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:06.410489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-aa5cef07-a11b-4df1-8af8-6eccff69d80f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:06.421089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa5cef07-a11b-4df1-8af8-6eccff69d80f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:06.421821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa5cef07-a11b-4df1-8af8-6eccff69d80f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:06.423126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa5cef07-a11b-4df1-8af8-6eccff69d80f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:06.423895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa5cef07-a11b-4df1-8af8-6eccff69d80f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:06.466184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-aa5cef07-a11b-4df1-8af8-6eccff69d80f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063638 Feb 21 00:43:06.466828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 305/580] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:06 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:07.481628 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3a20d346-865a-4f02-9244-996713751626 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:07.482925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3a20d346-865a-4f02-9244-996713751626 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:07.489537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a20d346-865a-4f02-9244-996713751626 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:07.489983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a20d346-865a-4f02-9244-996713751626 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:07.490756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a20d346-865a-4f02-9244-996713751626 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:07.491185 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a20d346-865a-4f02-9244-996713751626 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:07.523113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3a20d346-865a-4f02-9244-996713751626 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047984 Feb 21 00:43:07.523691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 276/581] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:07 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:08.536729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4c29bc9b-c83e-49e7-a7b4-2692314feb55 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:08.537666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4c29bc9b-c83e-49e7-a7b4-2692314feb55 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:08.544322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c29bc9b-c83e-49e7-a7b4-2692314feb55 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:08.544903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c29bc9b-c83e-49e7-a7b4-2692314feb55 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:08.545701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c29bc9b-c83e-49e7-a7b4-2692314feb55 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:08.546100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c29bc9b-c83e-49e7-a7b4-2692314feb55 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:08.576153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4c29bc9b-c83e-49e7-a7b4-2692314feb55 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043171 Feb 21 00:43:08.577138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 306/582] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:09.588445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d5e59d28-fc47-4ed3-a8a3-502f49909e80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:09.589365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d5e59d28-fc47-4ed3-a8a3-502f49909e80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:09.596134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5e59d28-fc47-4ed3-a8a3-502f49909e80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:09.596606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5e59d28-fc47-4ed3-a8a3-502f49909e80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:09.597369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5e59d28-fc47-4ed3-a8a3-502f49909e80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:09.597793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5e59d28-fc47-4ed3-a8a3-502f49909e80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:09.626652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d5e59d28-fc47-4ed3-a8a3-502f49909e80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042046 Feb 21 00:43:09.627207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 277/583] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:10.642331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-83232d3e-08c1-458f-a4a4-a52f088c694e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:10.643779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-83232d3e-08c1-458f-a4a4-a52f088c694e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:10.654289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83232d3e-08c1-458f-a4a4-a52f088c694e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:10.655016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83232d3e-08c1-458f-a4a4-a52f088c694e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:10.656695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83232d3e-08c1-458f-a4a4-a52f088c694e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:10.657351 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83232d3e-08c1-458f-a4a4-a52f088c694e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:10.690846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-83232d3e-08c1-458f-a4a4-a52f088c694e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054907 Feb 21 00:43:10.691372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 307/584] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:10 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:11.706832 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-79b3917c-0530-4be9-ae86-4e2b24cddf23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:11.708276 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-79b3917c-0530-4be9-ae86-4e2b24cddf23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:11.718119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79b3917c-0530-4be9-ae86-4e2b24cddf23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:11.718585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79b3917c-0530-4be9-ae86-4e2b24cddf23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:11.719351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79b3917c-0530-4be9-ae86-4e2b24cddf23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:11.719817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79b3917c-0530-4be9-ae86-4e2b24cddf23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:11.749013 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-79b3917c-0530-4be9-ae86-4e2b24cddf23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048648 Feb 21 00:43:11.749561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 278/585] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:12.761190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0a5a2794-da9b-4663-ae93-c859287fcf56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:12.762832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0a5a2794-da9b-4663-ae93-c859287fcf56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:12.769369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a5a2794-da9b-4663-ae93-c859287fcf56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:12.769802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a5a2794-da9b-4663-ae93-c859287fcf56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:12.770607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a5a2794-da9b-4663-ae93-c859287fcf56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:12.771034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a5a2794-da9b-4663-ae93-c859287fcf56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:12.801407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0a5a2794-da9b-4663-ae93-c859287fcf56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044519 Feb 21 00:43:12.801951 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 308/586] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:13.549395 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-69ea1e61-da80-4641-afef-97c50302e981 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:43:13.549906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-69ea1e61-da80-4641-afef-97c50302e981 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:13.556887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-69ea1e61-da80-4641-afef-97c50302e981 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:13.557340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-69ea1e61-da80-4641-afef-97c50302e981 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:13.558116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-69ea1e61-da80-4641-afef-97c50302e981 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:13.558545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-69ea1e61-da80-4641-afef-97c50302e981 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:13.581292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-69ea1e61-da80-4641-afef-97c50302e981 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lazy-loading 'flavor' on Instance uuid 9d201f02-8582-4720-942e-8d62400e176f {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:43:13.659239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-69ea1e61-da80-4641-afef-97c50302e981 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "POST /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f/action" status: 202 len: 0 microversion: 2.1 time: 0.113243 Feb 21 00:43:13.660258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 279/587] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:43:13 2022] POST /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:43:13.669535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c8454b40-bf9a-4d5f-8bf2-45d1a31871dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:13.670062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c8454b40-bf9a-4d5f-8bf2-45d1a31871dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:13.676076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c8454b40-bf9a-4d5f-8bf2-45d1a31871dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:13.676558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c8454b40-bf9a-4d5f-8bf2-45d1a31871dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:13.677323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c8454b40-bf9a-4d5f-8bf2-45d1a31871dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:13.677906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c8454b40-bf9a-4d5f-8bf2-45d1a31871dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:13.813740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a6d944e2-c97e-4792-bd84-170bc193953a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:13.814970 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a6d944e2-c97e-4792-bd84-170bc193953a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:13.822835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a6d944e2-c97e-4792-bd84-170bc193953a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:13.823281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a6d944e2-c97e-4792-bd84-170bc193953a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:13.823954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c8454b40-bf9a-4d5f-8bf2-45d1a31871dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:13.824481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a6d944e2-c97e-4792-bd84-170bc193953a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:13.824481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a6d944e2-c97e-4792-bd84-170bc193953a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:13.832196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c8454b40-bf9a-4d5f-8bf2-45d1a31871dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.166508 Feb 21 00:43:13.832840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 309/588] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:13.853980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a6d944e2-c97e-4792-bd84-170bc193953a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044524 Feb 21 00:43:13.854494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 280/589] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:14.853090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-165ba1ff-8f72-48d1-9f4f-d5e0433172f7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:14.853912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-165ba1ff-8f72-48d1-9f4f-d5e0433172f7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:14.864700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-165ba1ff-8f72-48d1-9f4f-d5e0433172f7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:14.865485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-165ba1ff-8f72-48d1-9f4f-d5e0433172f7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:14.866759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-165ba1ff-8f72-48d1-9f4f-d5e0433172f7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:14.867470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-165ba1ff-8f72-48d1-9f4f-d5e0433172f7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:14.869162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-72dc541e-9afe-4e0d-b4ce-0be72716fa02 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:14.870619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-72dc541e-9afe-4e0d-b4ce-0be72716fa02 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:14.877636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72dc541e-9afe-4e0d-b4ce-0be72716fa02 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:14.878073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72dc541e-9afe-4e0d-b4ce-0be72716fa02 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:14.878837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72dc541e-9afe-4e0d-b4ce-0be72716fa02 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:14.879259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72dc541e-9afe-4e0d-b4ce-0be72716fa02 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:14.910143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-72dc541e-9afe-4e0d-b4ce-0be72716fa02 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047214 Feb 21 00:43:14.910731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 281/590] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:15.002979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-165ba1ff-8f72-48d1-9f4f-d5e0433172f7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:15.010936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-165ba1ff-8f72-48d1-9f4f-d5e0433172f7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.164032 Feb 21 00:43:15.011504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 310/591] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:15.925742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-acd8c23c-6d4e-4777-99a2-86ff31be2db3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:15.926523 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-acd8c23c-6d4e-4777-99a2-86ff31be2db3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:15.933231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-acd8c23c-6d4e-4777-99a2-86ff31be2db3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:15.933672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-acd8c23c-6d4e-4777-99a2-86ff31be2db3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:15.934434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-acd8c23c-6d4e-4777-99a2-86ff31be2db3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:15.934861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-acd8c23c-6d4e-4777-99a2-86ff31be2db3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:15.964853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-acd8c23c-6d4e-4777-99a2-86ff31be2db3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045405 Feb 21 00:43:15.965402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 282/592] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:16.032193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-12f9a217-8e87-4058-9278-96bf98e1b370 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:16.033242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-12f9a217-8e87-4058-9278-96bf98e1b370 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:16.043790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-12f9a217-8e87-4058-9278-96bf98e1b370 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:16.044630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-12f9a217-8e87-4058-9278-96bf98e1b370 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:16.045440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-12f9a217-8e87-4058-9278-96bf98e1b370 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:16.045862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-12f9a217-8e87-4058-9278-96bf98e1b370 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:16.188767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-12f9a217-8e87-4058-9278-96bf98e1b370 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:16.196078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-12f9a217-8e87-4058-9278-96bf98e1b370 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.170468 Feb 21 00:43:16.196700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 311/593] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:16.977671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-faae67e3-0f49-4721-896a-d412aea02624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:16.978587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-faae67e3-0f49-4721-896a-d412aea02624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:16.985950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-faae67e3-0f49-4721-896a-d412aea02624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:16.986491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-faae67e3-0f49-4721-896a-d412aea02624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:16.987331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-faae67e3-0f49-4721-896a-d412aea02624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:16.987824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-faae67e3-0f49-4721-896a-d412aea02624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:17.018962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-faae67e3-0f49-4721-896a-d412aea02624 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045651 Feb 21 00:43:17.019519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 283/594] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:17.212533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a92a2f74-4d4a-466e-8543-730adcec7550 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:17.213138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a92a2f74-4d4a-466e-8543-730adcec7550 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:17.219782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a92a2f74-4d4a-466e-8543-730adcec7550 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:17.220220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a92a2f74-4d4a-466e-8543-730adcec7550 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:17.221021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a92a2f74-4d4a-466e-8543-730adcec7550 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:17.221448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a92a2f74-4d4a-466e-8543-730adcec7550 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:17.363137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a92a2f74-4d4a-466e-8543-730adcec7550 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:17.374259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a92a2f74-4d4a-466e-8543-730adcec7550 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.165027 Feb 21 00:43:17.375090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 312/595] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:17 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:18.035405 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8c5d57e3-5de3-4ccc-ac5e-78193bb2ab52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:18.036903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8c5d57e3-5de3-4ccc-ac5e-78193bb2ab52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:18.046542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8c5d57e3-5de3-4ccc-ac5e-78193bb2ab52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:18.046984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8c5d57e3-5de3-4ccc-ac5e-78193bb2ab52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:18.047746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8c5d57e3-5de3-4ccc-ac5e-78193bb2ab52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:18.048179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8c5d57e3-5de3-4ccc-ac5e-78193bb2ab52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:18.077283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8c5d57e3-5de3-4ccc-ac5e-78193bb2ab52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048859 Feb 21 00:43:18.077830 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 284/596] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:18.400310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ed78d269-0dc9-4db1-a8b7-a187e4eb2d7e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:18.401235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ed78d269-0dc9-4db1-a8b7-a187e4eb2d7e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:18.409220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ed78d269-0dc9-4db1-a8b7-a187e4eb2d7e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:18.409663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ed78d269-0dc9-4db1-a8b7-a187e4eb2d7e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:18.410441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ed78d269-0dc9-4db1-a8b7-a187e4eb2d7e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:18.410869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ed78d269-0dc9-4db1-a8b7-a187e4eb2d7e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:18.563609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ed78d269-0dc9-4db1-a8b7-a187e4eb2d7e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:18.573576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ed78d269-0dc9-4db1-a8b7-a187e4eb2d7e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.179312 Feb 21 00:43:18.574349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 313/597] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:18 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:19.092298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-52d2e9c7-0822-4fb1-9f69-c90ca745cc54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:19.093223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-52d2e9c7-0822-4fb1-9f69-c90ca745cc54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:19.099984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52d2e9c7-0822-4fb1-9f69-c90ca745cc54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:19.100426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52d2e9c7-0822-4fb1-9f69-c90ca745cc54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:19.101239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52d2e9c7-0822-4fb1-9f69-c90ca745cc54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:19.101669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52d2e9c7-0822-4fb1-9f69-c90ca745cc54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:19.131110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-52d2e9c7-0822-4fb1-9f69-c90ca745cc54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044700 Feb 21 00:43:19.131655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 285/598] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:19.599329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-49cf5b6a-203c-4158-bc0c-c71765b7d7af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:19.602051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-49cf5b6a-203c-4158-bc0c-c71765b7d7af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:19.609444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-49cf5b6a-203c-4158-bc0c-c71765b7d7af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:19.609878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-49cf5b6a-203c-4158-bc0c-c71765b7d7af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:19.610642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-49cf5b6a-203c-4158-bc0c-c71765b7d7af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:19.611060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-49cf5b6a-203c-4158-bc0c-c71765b7d7af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:19.755396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-49cf5b6a-203c-4158-bc0c-c71765b7d7af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:19.766305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-49cf5b6a-203c-4158-bc0c-c71765b7d7af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.172712 Feb 21 00:43:19.767238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 314/599] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:19 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:20.146078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f531f41d-85ee-43c8-a302-5b10a3174139 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:20.147554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f531f41d-85ee-43c8-a302-5b10a3174139 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:20.156968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f531f41d-85ee-43c8-a302-5b10a3174139 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:20.157409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f531f41d-85ee-43c8-a302-5b10a3174139 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:20.158191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f531f41d-85ee-43c8-a302-5b10a3174139 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:20.158621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f531f41d-85ee-43c8-a302-5b10a3174139 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:20.188126 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f531f41d-85ee-43c8-a302-5b10a3174139 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048565 Feb 21 00:43:20.188709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 286/600] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:20.789653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-40698391-6c33-4a19-b017-0c6c7d8766e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:20.790487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-40698391-6c33-4a19-b017-0c6c7d8766e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:20.801281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40698391-6c33-4a19-b017-0c6c7d8766e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:20.802068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40698391-6c33-4a19-b017-0c6c7d8766e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:20.803341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40698391-6c33-4a19-b017-0c6c7d8766e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:20.804051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40698391-6c33-4a19-b017-0c6c7d8766e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:20.944141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-40698391-6c33-4a19-b017-0c6c7d8766e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:20.951617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-40698391-6c33-4a19-b017-0c6c7d8766e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.168257 Feb 21 00:43:20.952185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 315/601] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:20 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:21.203838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7c80fc7e-4766-4e3c-8fee-46a8e3ceea79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:21.205215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7c80fc7e-4766-4e3c-8fee-46a8e3ceea79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:21.215728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c80fc7e-4766-4e3c-8fee-46a8e3ceea79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:21.216454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c80fc7e-4766-4e3c-8fee-46a8e3ceea79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:21.217771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c80fc7e-4766-4e3c-8fee-46a8e3ceea79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:21.218479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c80fc7e-4766-4e3c-8fee-46a8e3ceea79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:21.253709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7c80fc7e-4766-4e3c-8fee-46a8e3ceea79 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056393 Feb 21 00:43:21.254255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 287/602] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:21.972524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8e206e7c-6c6c-4c05-bded-280ae208ef91 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:21.973384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8e206e7c-6c6c-4c05-bded-280ae208ef91 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:21.983116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e206e7c-6c6c-4c05-bded-280ae208ef91 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:21.983586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e206e7c-6c6c-4c05-bded-280ae208ef91 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:21.984349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e206e7c-6c6c-4c05-bded-280ae208ef91 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:21.984800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e206e7c-6c6c-4c05-bded-280ae208ef91 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:22.137146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8e206e7c-6c6c-4c05-bded-280ae208ef91 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:22.144901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8e206e7c-6c6c-4c05-bded-280ae208ef91 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.178768 Feb 21 00:43:22.145456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 316/603] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:21 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:22.269280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9d636a59-b1cd-4c2b-9c1d-657f85499672 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:22.270739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9d636a59-b1cd-4c2b-9c1d-657f85499672 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:22.280358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d636a59-b1cd-4c2b-9c1d-657f85499672 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:22.281151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d636a59-b1cd-4c2b-9c1d-657f85499672 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:22.281953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d636a59-b1cd-4c2b-9c1d-657f85499672 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:22.282355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d636a59-b1cd-4c2b-9c1d-657f85499672 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:22.312328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9d636a59-b1cd-4c2b-9c1d-657f85499672 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049347 Feb 21 00:43:22.312928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 288/604] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:23.163936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8b211b3d-dd79-42a2-9761-9e5cf47e682d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:23.164692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8b211b3d-dd79-42a2-9761-9e5cf47e682d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:23.173128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b211b3d-dd79-42a2-9761-9e5cf47e682d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:23.173687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b211b3d-dd79-42a2-9761-9e5cf47e682d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:23.174654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b211b3d-dd79-42a2-9761-9e5cf47e682d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:23.175193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b211b3d-dd79-42a2-9761-9e5cf47e682d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:23.314621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8b211b3d-dd79-42a2-9761-9e5cf47e682d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:23.322443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8b211b3d-dd79-42a2-9761-9e5cf47e682d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.163125 Feb 21 00:43:23.323010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 317/605] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:23 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:23.323163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8c559b0c-c400-40d2-8132-2bb77ea4692f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:23.324008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8c559b0c-c400-40d2-8132-2bb77ea4692f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:23.330529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8c559b0c-c400-40d2-8132-2bb77ea4692f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:23.330966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8c559b0c-c400-40d2-8132-2bb77ea4692f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:23.331728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8c559b0c-c400-40d2-8132-2bb77ea4692f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:23.332148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8c559b0c-c400-40d2-8132-2bb77ea4692f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:23.361960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8c559b0c-c400-40d2-8132-2bb77ea4692f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042542 Feb 21 00:43:23.362729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 289/606] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:23.565798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-87a6076b-4612-43e8-bce8-b8106d2ad0b3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:23.566326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-87a6076b-4612-43e8-bce8-b8106d2ad0b3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:23.572881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-87a6076b-4612-43e8-bce8-b8106d2ad0b3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:23.573318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-87a6076b-4612-43e8-bce8-b8106d2ad0b3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:23.574099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-87a6076b-4612-43e8-bce8-b8106d2ad0b3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:23.574532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-87a6076b-4612-43e8-bce8-b8106d2ad0b3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:23.600682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-87a6076b-4612-43e8-bce8-b8106d2ad0b3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Going to try to terminate instance {{(pid=123098) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:43:23.694304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-87a6076b-4612-43e8-bce8-b8106d2ad0b3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 204 len: 0 microversion: 2.1 time: 0.131951 Feb 21 00:43:23.694892 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 318/607] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:43:23 2022] DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:43:23.702897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-77e6a7cf-2b23-483e-9a64-b575f05fbdef tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:23.703499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-77e6a7cf-2b23-483e-9a64-b575f05fbdef tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:23.709535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-77e6a7cf-2b23-483e-9a64-b575f05fbdef tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:23.709977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-77e6a7cf-2b23-483e-9a64-b575f05fbdef tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:23.710733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-77e6a7cf-2b23-483e-9a64-b575f05fbdef tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:23.711162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-77e6a7cf-2b23-483e-9a64-b575f05fbdef tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:23.859297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-77e6a7cf-2b23-483e-9a64-b575f05fbdef tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:23.870564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-77e6a7cf-2b23-483e-9a64-b575f05fbdef tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1577 microversion: 2.1 time: 0.171051 Feb 21 00:43:23.871398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 290/608] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:23 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:24.339642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6ea9b02b-ff47-4172-af6c-70d705a77526 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:24.340364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6ea9b02b-ff47-4172-af6c-70d705a77526 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:24.347064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ea9b02b-ff47-4172-af6c-70d705a77526 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:24.347508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ea9b02b-ff47-4172-af6c-70d705a77526 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:24.348285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ea9b02b-ff47-4172-af6c-70d705a77526 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:24.348747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ea9b02b-ff47-4172-af6c-70d705a77526 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:24.373514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-79d93a3d-47e2-4522-8784-0dbbb3433755 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:24.374428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-79d93a3d-47e2-4522-8784-0dbbb3433755 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:24.380977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79d93a3d-47e2-4522-8784-0dbbb3433755 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:24.381415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79d93a3d-47e2-4522-8784-0dbbb3433755 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:24.382537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79d93a3d-47e2-4522-8784-0dbbb3433755 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:24.382668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79d93a3d-47e2-4522-8784-0dbbb3433755 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:24.413846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-79d93a3d-47e2-4522-8784-0dbbb3433755 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044088 Feb 21 00:43:24.414557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 291/609] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:24.505182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6ea9b02b-ff47-4172-af6c-70d705a77526 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:24.512843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6ea9b02b-ff47-4172-af6c-70d705a77526 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.177294 Feb 21 00:43:24.513519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 319/610] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:24 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:24.891073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dce8d72b-edb4-4516-bc04-81a0e44833e2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:24.891959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dce8d72b-edb4-4516-bc04-81a0e44833e2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:24.901249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dce8d72b-edb4-4516-bc04-81a0e44833e2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:24.901871 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dce8d72b-edb4-4516-bc04-81a0e44833e2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:24.902997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dce8d72b-edb4-4516-bc04-81a0e44833e2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:24.903629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dce8d72b-edb4-4516-bc04-81a0e44833e2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:25.054467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dce8d72b-edb4-4516-bc04-81a0e44833e2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:25.062448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dce8d72b-edb4-4516-bc04-81a0e44833e2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1577 microversion: 2.1 time: 0.176735 Feb 21 00:43:25.062997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 292/611] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:24 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:25.429740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bd69f7ee-f3a2-4560-98aa-10a77385e6a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:25.431333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bd69f7ee-f3a2-4560-98aa-10a77385e6a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:25.439219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd69f7ee-f3a2-4560-98aa-10a77385e6a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:25.439664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd69f7ee-f3a2-4560-98aa-10a77385e6a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:25.440479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd69f7ee-f3a2-4560-98aa-10a77385e6a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:25.440906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd69f7ee-f3a2-4560-98aa-10a77385e6a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:25.470235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bd69f7ee-f3a2-4560-98aa-10a77385e6a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047214 Feb 21 00:43:25.470806 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 320/612] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:25.532867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-52f8f98d-5a4a-418d-a1a3-aac39516a2ba tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:25.533782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-52f8f98d-5a4a-418d-a1a3-aac39516a2ba tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:25.543645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52f8f98d-5a4a-418d-a1a3-aac39516a2ba tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:25.544469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52f8f98d-5a4a-418d-a1a3-aac39516a2ba tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:25.545265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52f8f98d-5a4a-418d-a1a3-aac39516a2ba tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:25.545694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52f8f98d-5a4a-418d-a1a3-aac39516a2ba tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:25.697764 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-52f8f98d-5a4a-418d-a1a3-aac39516a2ba tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:25.705618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-52f8f98d-5a4a-418d-a1a3-aac39516a2ba tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.178795 Feb 21 00:43:25.706189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 293/613] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:25 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:26.080672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9a85ef73-07eb-4c5c-b97e-0a5cb28c6cc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:26.081284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9a85ef73-07eb-4c5c-b97e-0a5cb28c6cc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:26.087763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a85ef73-07eb-4c5c-b97e-0a5cb28c6cc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:26.088203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a85ef73-07eb-4c5c-b97e-0a5cb28c6cc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:26.089120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a85ef73-07eb-4c5c-b97e-0a5cb28c6cc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:26.089646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a85ef73-07eb-4c5c-b97e-0a5cb28c6cc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:26.299015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9a85ef73-07eb-4c5c-b97e-0a5cb28c6cc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:26.307082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9a85ef73-07eb-4c5c-b97e-0a5cb28c6cc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1577 microversion: 2.1 time: 0.230449 Feb 21 00:43:26.314107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 321/614] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:26 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:26.481806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-245c78a8-d589-42e1-95d7-1b56c87e38ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:26.482699 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-245c78a8-d589-42e1-95d7-1b56c87e38ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:26.488967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-245c78a8-d589-42e1-95d7-1b56c87e38ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:26.489411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-245c78a8-d589-42e1-95d7-1b56c87e38ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:26.490165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-245c78a8-d589-42e1-95d7-1b56c87e38ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:26.490604 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-245c78a8-d589-42e1-95d7-1b56c87e38ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:26.520996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-245c78a8-d589-42e1-95d7-1b56c87e38ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042989 Feb 21 00:43:26.521801 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 294/615] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:26.722930 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-53c28e4f-e1e4-4c43-8c53-467d607d2045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:26.724237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-53c28e4f-e1e4-4c43-8c53-467d607d2045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:26.725915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-7ba6f7e6-2fd6-4975-9c7a-d67a0e768a2f req-7ef7dec7-ddc2-4df7-a010-c50b3fd9a7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf1e55d-f089-4700-84ba-c7daee664ac5", "name": "network-vif-deleted", "tag": "91e1b094-1b34-4120-8622-d4c4e422029c"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:43:26.727462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:43:26.727462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:43:26.731797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53c28e4f-e1e4-4c43-8c53-467d607d2045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:26.732244 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53c28e4f-e1e4-4c43-8c53-467d607d2045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:26.733282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53c28e4f-e1e4-4c43-8c53-467d607d2045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:26.733716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53c28e4f-e1e4-4c43-8c53-467d607d2045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:26.734908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-7ba6f7e6-2fd6-4975-9c7a-d67a0e768a2f req-7ef7dec7-ddc2-4df7-a010-c50b3fd9a7b7 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:26.735483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-7ba6f7e6-2fd6-4975-9c7a-d67a0e768a2f req-7ef7dec7-ddc2-4df7-a010-c50b3fd9a7b7 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:26.747542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-7ba6f7e6-2fd6-4975-9c7a-d67a0e768a2f req-7ef7dec7-ddc2-4df7-a010-c50b3fd9a7b7 service nova] Creating event network-vif-deleted:91e1b094-1b34-4120-8622-d4c4e422029c for instance eaf1e55d-f089-4700-84ba-c7daee664ac5 on hv-cinder-81322 Feb 21 00:43:26.752747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-7ba6f7e6-2fd6-4975-9c7a-d67a0e768a2f req-7ef7dec7-ddc2-4df7-a010-c50b3fd9a7b7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090744 Feb 21 00:43:26.753895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 322/616] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:43:26.879402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53c28e4f-e1e4-4c43-8c53-467d607d2045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:26.888848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-53c28e4f-e1e4-4c43-8c53-467d607d2045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.169885 Feb 21 00:43:26.889411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 295/617] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:43:27.324452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-89102607-2150-4952-84c4-004dbb6a0be6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:27.325200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-89102607-2150-4952-84c4-004dbb6a0be6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:27.331666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89102607-2150-4952-84c4-004dbb6a0be6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:27.332108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89102607-2150-4952-84c4-004dbb6a0be6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:27.332919 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89102607-2150-4952-84c4-004dbb6a0be6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:27.333344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89102607-2150-4952-84c4-004dbb6a0be6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:27.399792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-89102607-2150-4952-84c4-004dbb6a0be6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:27.408137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-89102607-2150-4952-84c4-004dbb6a0be6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.087844 Feb 21 00:43:27.408878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 323/618] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:27 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:27.533350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-75391578-8c66-483c-9d55-0cc36b946759 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:27.534490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-75391578-8c66-483c-9d55-0cc36b946759 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:27.540861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75391578-8c66-483c-9d55-0cc36b946759 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:27.541293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75391578-8c66-483c-9d55-0cc36b946759 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:27.542084 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75391578-8c66-483c-9d55-0cc36b946759 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:27.542530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75391578-8c66-483c-9d55-0cc36b946759 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:27.572626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-75391578-8c66-483c-9d55-0cc36b946759 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043650 Feb 21 00:43:27.573216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 296/619] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 00:43:27.909649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9d89e0fe-017f-4e22-bb89-53e706f39909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:27.910302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9d89e0fe-017f-4e22-bb89-53e706f39909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:27.920202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d89e0fe-017f-4e22-bb89-53e706f39909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:27.920670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d89e0fe-017f-4e22-bb89-53e706f39909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:27.921443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d89e0fe-017f-4e22-bb89-53e706f39909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:27.921864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d89e0fe-017f-4e22-bb89-53e706f39909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:28.059034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9d89e0fe-017f-4e22-bb89-53e706f39909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:28.067092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9d89e0fe-017f-4e22-bb89-53e706f39909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.163564 Feb 21 00:43:28.067662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 324/620] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:28.425496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a308c4d8-4d88-4e14-94e0-fc7302448393 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:28.426048 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a308c4d8-4d88-4e14-94e0-fc7302448393 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:28.432543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a308c4d8-4d88-4e14-94e0-fc7302448393 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:28.432992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a308c4d8-4d88-4e14-94e0-fc7302448393 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:28.433788 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a308c4d8-4d88-4e14-94e0-fc7302448393 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:28.434200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a308c4d8-4d88-4e14-94e0-fc7302448393 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:28.495067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a308c4d8-4d88-4e14-94e0-fc7302448393 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:28.502625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a308c4d8-4d88-4e14-94e0-fc7302448393 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.081082 Feb 21 00:43:28.503187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 297/621] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:28 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:28.584414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-337d2552-35a5-41a2-b759-034db7e6f517 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:28.585352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-337d2552-35a5-41a2-b759-034db7e6f517 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:28.591758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-337d2552-35a5-41a2-b759-034db7e6f517 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:28.592204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-337d2552-35a5-41a2-b759-034db7e6f517 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:28.593007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-337d2552-35a5-41a2-b759-034db7e6f517 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:28.593434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-337d2552-35a5-41a2-b759-034db7e6f517 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:28.623984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-337d2552-35a5-41a2-b759-034db7e6f517 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043390 Feb 21 00:43:28.624584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 325/622] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:29.083921 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0bf8a196-ec9e-4c12-937d-689a3bb16b7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:29.084536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0bf8a196-ec9e-4c12-937d-689a3bb16b7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:29.091020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0bf8a196-ec9e-4c12-937d-689a3bb16b7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:29.091461 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0bf8a196-ec9e-4c12-937d-689a3bb16b7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:29.092234 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0bf8a196-ec9e-4c12-937d-689a3bb16b7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:29.092697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0bf8a196-ec9e-4c12-937d-689a3bb16b7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:29.228127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0bf8a196-ec9e-4c12-937d-689a3bb16b7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:29.236070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0bf8a196-ec9e-4c12-937d-689a3bb16b7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.155846 Feb 21 00:43:29.236674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 298/623] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:29 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:29.520043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-df1814a1-aa8f-4af3-b561-17e313931818 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:29.520896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-df1814a1-aa8f-4af3-b561-17e313931818 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:29.527890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df1814a1-aa8f-4af3-b561-17e313931818 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:29.528024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df1814a1-aa8f-4af3-b561-17e313931818 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:29.529244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df1814a1-aa8f-4af3-b561-17e313931818 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:29.529677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df1814a1-aa8f-4af3-b561-17e313931818 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:29.591301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df1814a1-aa8f-4af3-b561-17e313931818 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:29.598938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-df1814a1-aa8f-4af3-b561-17e313931818 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.082806 Feb 21 00:43:29.608264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 326/624] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:29 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:29.635271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b39cab9b-811a-415d-8ba3-0e09336ea9c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:29.636607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b39cab9b-811a-415d-8ba3-0e09336ea9c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:29.643494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b39cab9b-811a-415d-8ba3-0e09336ea9c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:29.644081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b39cab9b-811a-415d-8ba3-0e09336ea9c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:29.645000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b39cab9b-811a-415d-8ba3-0e09336ea9c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:29.645450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b39cab9b-811a-415d-8ba3-0e09336ea9c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:29.675833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b39cab9b-811a-415d-8ba3-0e09336ea9c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044366 Feb 21 00:43:29.679796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 299/625] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 00:43:29.748536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-69c43bf6-0b56-403e-b231-0bee15d9e273 req-f851bff9-114b-4abf-8c96-1a20d249bc41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d201f02-8582-4720-942e-8d62400e176f", "name": "network-vif-unplugged", "status": "completed", "tag": "bf929627-3fbe-4a88-9f95-bbe9870fa556"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:43:29.750339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:43:29.750339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:43:29.758731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-69c43bf6-0b56-403e-b231-0bee15d9e273 req-f851bff9-114b-4abf-8c96-1a20d249bc41 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:29.759236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-69c43bf6-0b56-403e-b231-0bee15d9e273 req-f851bff9-114b-4abf-8c96-1a20d249bc41 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:29.770236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-69c43bf6-0b56-403e-b231-0bee15d9e273 req-f851bff9-114b-4abf-8c96-1a20d249bc41 service nova] Creating event network-vif-unplugged:bf929627-3fbe-4a88-9f95-bbe9870fa556 for instance 9d201f02-8582-4720-942e-8d62400e176f on hv-cinder-81322 Feb 21 00:43:29.774924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-69c43bf6-0b56-403e-b231-0bee15d9e273 req-f851bff9-114b-4abf-8c96-1a20d249bc41 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086295 Feb 21 00:43:29.775506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 327/626] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:43:30.253123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f2a20485-6b4f-4378-a671-76d95f58bc30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:30.253728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f2a20485-6b4f-4378-a671-76d95f58bc30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:30.260287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f2a20485-6b4f-4378-a671-76d95f58bc30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:30.260753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f2a20485-6b4f-4378-a671-76d95f58bc30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:30.261585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f2a20485-6b4f-4378-a671-76d95f58bc30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:30.262012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f2a20485-6b4f-4378-a671-76d95f58bc30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:30.400527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f2a20485-6b4f-4378-a671-76d95f58bc30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:30.408527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f2a20485-6b4f-4378-a671-76d95f58bc30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.159025 Feb 21 00:43:30.409082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 300/627] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:30 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:30.619928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-715f1736-3381-4c29-9477-ca62a925e35a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:30.621145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-715f1736-3381-4c29-9477-ca62a925e35a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:30.629167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-715f1736-3381-4c29-9477-ca62a925e35a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:30.629662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-715f1736-3381-4c29-9477-ca62a925e35a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:30.630509 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-715f1736-3381-4c29-9477-ca62a925e35a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:30.630980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-715f1736-3381-4c29-9477-ca62a925e35a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:30.687321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-44727a4c-7f56-44c3-99ad-b339af7bebe6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:30.688364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-44727a4c-7f56-44c3-99ad-b339af7bebe6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:30.693399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-715f1736-3381-4c29-9477-ca62a925e35a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:30.695207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-44727a4c-7f56-44c3-99ad-b339af7bebe6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:30.695543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-44727a4c-7f56-44c3-99ad-b339af7bebe6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:30.696317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-44727a4c-7f56-44c3-99ad-b339af7bebe6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:30.696779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-44727a4c-7f56-44c3-99ad-b339af7bebe6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:30.701047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-715f1736-3381-4c29-9477-ca62a925e35a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.087839 Feb 21 00:43:30.701618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 328/628] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:30 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:30.728294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-44727a4c-7f56-44c3-99ad-b339af7bebe6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044799 Feb 21 00:43:30.728875 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 301/629] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:31.429793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7eba34b2-64b0-4838-9163-4a309a9350db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:31.430793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7eba34b2-64b0-4838-9163-4a309a9350db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:31.438684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eba34b2-64b0-4838-9163-4a309a9350db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:31.439128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eba34b2-64b0-4838-9163-4a309a9350db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:31.439899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eba34b2-64b0-4838-9163-4a309a9350db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:31.440324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eba34b2-64b0-4838-9163-4a309a9350db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:31.585603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7eba34b2-64b0-4838-9163-4a309a9350db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:31.593462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7eba34b2-64b0-4838-9163-4a309a9350db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.169847 Feb 21 00:43:31.594021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 329/630] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:31 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:31.721606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-71f8d9cf-95d2-486d-97d5-51a9de588a66 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:31.722442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-71f8d9cf-95d2-486d-97d5-51a9de588a66 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:31.732482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71f8d9cf-95d2-486d-97d5-51a9de588a66 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:31.732927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71f8d9cf-95d2-486d-97d5-51a9de588a66 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:31.733688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71f8d9cf-95d2-486d-97d5-51a9de588a66 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:31.734118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-71f8d9cf-95d2-486d-97d5-51a9de588a66 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:31.739102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2a8533c0-9a8d-472a-ad1d-c7881b3651e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:31.740058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2a8533c0-9a8d-472a-ad1d-c7881b3651e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:31.746610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a8533c0-9a8d-472a-ad1d-c7881b3651e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:31.747066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a8533c0-9a8d-472a-ad1d-c7881b3651e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:31.747827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a8533c0-9a8d-472a-ad1d-c7881b3651e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:31.748254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a8533c0-9a8d-472a-ad1d-c7881b3651e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:31.778752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2a8533c0-9a8d-472a-ad1d-c7881b3651e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043363 Feb 21 00:43:31.779527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 330/631] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:31.794837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-71f8d9cf-95d2-486d-97d5-51a9de588a66 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:31.802682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-71f8d9cf-95d2-486d-97d5-51a9de588a66 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.087330 Feb 21 00:43:31.803251 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 302/632] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:31 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:32.614215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c1d5ab4e-94c1-4a65-a899-9ffd205e1b3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:32.615203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c1d5ab4e-94c1-4a65-a899-9ffd205e1b3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:32.624120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c1d5ab4e-94c1-4a65-a899-9ffd205e1b3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:32.624600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c1d5ab4e-94c1-4a65-a899-9ffd205e1b3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:32.625485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c1d5ab4e-94c1-4a65-a899-9ffd205e1b3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:32.625917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c1d5ab4e-94c1-4a65-a899-9ffd205e1b3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:32.760669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c1d5ab4e-94c1-4a65-a899-9ffd205e1b3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:32.768463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c1d5ab4e-94c1-4a65-a899-9ffd205e1b3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.160331 Feb 21 00:43:32.769027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 331/633] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:32 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:32.791057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-411cf63e-49d0-4069-998c-f79e722f5792 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:32.791896 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-411cf63e-49d0-4069-998c-f79e722f5792 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:32.800151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-411cf63e-49d0-4069-998c-f79e722f5792 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:32.800877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-411cf63e-49d0-4069-998c-f79e722f5792 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:32.801835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-411cf63e-49d0-4069-998c-f79e722f5792 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:32.802596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-411cf63e-49d0-4069-998c-f79e722f5792 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:32.818849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bd880e3a-6aa0-4735-a88d-5136998be769 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:32.819485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bd880e3a-6aa0-4735-a88d-5136998be769 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:32.825540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd880e3a-6aa0-4735-a88d-5136998be769 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:32.825977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd880e3a-6aa0-4735-a88d-5136998be769 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:32.826733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd880e3a-6aa0-4735-a88d-5136998be769 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:32.827155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd880e3a-6aa0-4735-a88d-5136998be769 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:32.832467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-411cf63e-49d0-4069-998c-f79e722f5792 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045353 Feb 21 00:43:32.833047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 303/634] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:32.889440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bd880e3a-6aa0-4735-a88d-5136998be769 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:32.897229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bd880e3a-6aa0-4735-a88d-5136998be769 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.082002 Feb 21 00:43:32.897802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 332/635] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:32 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:33.790124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-107d03d6-2927-4e10-9971-fe3156295461 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:33.791256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-107d03d6-2927-4e10-9971-fe3156295461 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:33.798574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-107d03d6-2927-4e10-9971-fe3156295461 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:33.799021 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-107d03d6-2927-4e10-9971-fe3156295461 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:33.799796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-107d03d6-2927-4e10-9971-fe3156295461 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:33.800222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-107d03d6-2927-4e10-9971-fe3156295461 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:33.843263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-406cf2eb-4d65-46af-98a3-2865f161dc25 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:33.844314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-406cf2eb-4d65-46af-98a3-2865f161dc25 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:33.851086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-406cf2eb-4d65-46af-98a3-2865f161dc25 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:33.851519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-406cf2eb-4d65-46af-98a3-2865f161dc25 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:33.852307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-406cf2eb-4d65-46af-98a3-2865f161dc25 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:33.852772 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-406cf2eb-4d65-46af-98a3-2865f161dc25 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:33.882100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-406cf2eb-4d65-46af-98a3-2865f161dc25 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042614 Feb 21 00:43:33.882674 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 333/636] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:33.914432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-861b43c2-f519-4d80-b291-bb0f96bcb283 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:33.915444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-861b43c2-f519-4d80-b291-bb0f96bcb283 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:33.921834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-861b43c2-f519-4d80-b291-bb0f96bcb283 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:33.922283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-861b43c2-f519-4d80-b291-bb0f96bcb283 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:33.923047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-861b43c2-f519-4d80-b291-bb0f96bcb283 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:33.923473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-861b43c2-f519-4d80-b291-bb0f96bcb283 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:33.937338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-107d03d6-2927-4e10-9971-fe3156295461 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:33.944826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-107d03d6-2927-4e10-9971-fe3156295461 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161006 Feb 21 00:43:33.945361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 304/637] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:33 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:33.983282 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-861b43c2-f519-4d80-b291-bb0f96bcb283 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:33.990627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-861b43c2-f519-4d80-b291-bb0f96bcb283 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.079883 Feb 21 00:43:33.991209 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 334/638] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:33 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:34.897692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b31c1dba-6ecf-425b-86e4-98da8df36fe5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:34.899061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b31c1dba-6ecf-425b-86e4-98da8df36fe5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:34.907731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b31c1dba-6ecf-425b-86e4-98da8df36fe5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:34.908166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b31c1dba-6ecf-425b-86e4-98da8df36fe5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:34.908985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b31c1dba-6ecf-425b-86e4-98da8df36fe5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:34.909413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b31c1dba-6ecf-425b-86e4-98da8df36fe5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:34.938993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b31c1dba-6ecf-425b-86e4-98da8df36fe5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047864 Feb 21 00:43:34.939581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 305/639] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:34.961836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-757ef013-17c3-4660-8d02-91582156b4ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:34.962430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-757ef013-17c3-4660-8d02-91582156b4ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:34.969093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-757ef013-17c3-4660-8d02-91582156b4ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:34.969529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-757ef013-17c3-4660-8d02-91582156b4ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:34.970292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-757ef013-17c3-4660-8d02-91582156b4ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:34.970712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-757ef013-17c3-4660-8d02-91582156b4ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:35.006831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2ee08828-7847-4b6e-9b14-de412f4332ee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:35.007441 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2ee08828-7847-4b6e-9b14-de412f4332ee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:35.013831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ee08828-7847-4b6e-9b14-de412f4332ee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:35.014284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ee08828-7847-4b6e-9b14-de412f4332ee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:35.015064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ee08828-7847-4b6e-9b14-de412f4332ee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:35.015495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ee08828-7847-4b6e-9b14-de412f4332ee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:35.078255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2ee08828-7847-4b6e-9b14-de412f4332ee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:35.085714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2ee08828-7847-4b6e-9b14-de412f4332ee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.082545 Feb 21 00:43:35.086277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 306/640] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:35 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:35.105626 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-757ef013-17c3-4660-8d02-91582156b4ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:35.113333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-757ef013-17c3-4660-8d02-91582156b4ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.155177 Feb 21 00:43:35.113887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 335/641] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:34 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:35.954865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8d31827a-696e-4fc1-b342-da6e3092d578 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:35.956229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8d31827a-696e-4fc1-b342-da6e3092d578 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:35.966467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d31827a-696e-4fc1-b342-da6e3092d578 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:35.966903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d31827a-696e-4fc1-b342-da6e3092d578 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:35.967670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d31827a-696e-4fc1-b342-da6e3092d578 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:35.968196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d31827a-696e-4fc1-b342-da6e3092d578 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:35.997474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8d31827a-696e-4fc1-b342-da6e3092d578 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049182 Feb 21 00:43:35.998016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 307/642] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:35 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:36.106096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-78e64c63-f3d7-47c2-93e8-be62363df17e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:36.106750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-78e64c63-f3d7-47c2-93e8-be62363df17e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:36.113832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78e64c63-f3d7-47c2-93e8-be62363df17e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:36.114299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78e64c63-f3d7-47c2-93e8-be62363df17e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:36.115111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78e64c63-f3d7-47c2-93e8-be62363df17e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:36.115559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78e64c63-f3d7-47c2-93e8-be62363df17e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:36.130382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1af563bb-faf8-462d-8f7a-d17a5125dc8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:36.131027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1af563bb-faf8-462d-8f7a-d17a5125dc8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:36.137665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1af563bb-faf8-462d-8f7a-d17a5125dc8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:36.138111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1af563bb-faf8-462d-8f7a-d17a5125dc8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:36.138890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1af563bb-faf8-462d-8f7a-d17a5125dc8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:36.139323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1af563bb-faf8-462d-8f7a-d17a5125dc8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:36.176259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-78e64c63-f3d7-47c2-93e8-be62363df17e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:36.183985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-78e64c63-f3d7-47c2-93e8-be62363df17e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.084166 Feb 21 00:43:36.184572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 336/643] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:36 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:36.284062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1af563bb-faf8-462d-8f7a-d17a5125dc8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:36.295280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1af563bb-faf8-462d-8f7a-d17a5125dc8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.168788 Feb 21 00:43:36.295847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 308/644] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:36 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:37.014033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a0e38895-889a-4bab-8ef0-c631a8cf2756 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:37.015217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a0e38895-889a-4bab-8ef0-c631a8cf2756 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:37.021985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0e38895-889a-4bab-8ef0-c631a8cf2756 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:37.022469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0e38895-889a-4bab-8ef0-c631a8cf2756 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:37.023244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0e38895-889a-4bab-8ef0-c631a8cf2756 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:37.023711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0e38895-889a-4bab-8ef0-c631a8cf2756 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:37.064496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a0e38895-889a-4bab-8ef0-c631a8cf2756 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056039 Feb 21 00:43:37.065485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 337/645] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:37 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:37.204434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-080cd523-c7ab-46c4-9b1e-aa8fc9ad8967 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:37.205488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-080cd523-c7ab-46c4-9b1e-aa8fc9ad8967 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:37.214978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-080cd523-c7ab-46c4-9b1e-aa8fc9ad8967 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:37.215774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-080cd523-c7ab-46c4-9b1e-aa8fc9ad8967 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:37.216862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-080cd523-c7ab-46c4-9b1e-aa8fc9ad8967 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:37.217462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-080cd523-c7ab-46c4-9b1e-aa8fc9ad8967 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:37.288427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-080cd523-c7ab-46c4-9b1e-aa8fc9ad8967 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:37.296740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-080cd523-c7ab-46c4-9b1e-aa8fc9ad8967 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.098565 Feb 21 00:43:37.297379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 309/646] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:37 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:37.322558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bb13cc53-62d8-4a6c-819f-d4dbe3f94838 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:37.323297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bb13cc53-62d8-4a6c-819f-d4dbe3f94838 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:37.330322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb13cc53-62d8-4a6c-819f-d4dbe3f94838 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:37.330823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb13cc53-62d8-4a6c-819f-d4dbe3f94838 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:37.331685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb13cc53-62d8-4a6c-819f-d4dbe3f94838 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:37.332182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb13cc53-62d8-4a6c-819f-d4dbe3f94838 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:37.654279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb13cc53-62d8-4a6c-819f-d4dbe3f94838 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:37.662809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bb13cc53-62d8-4a6c-819f-d4dbe3f94838 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.345112 Feb 21 00:43:37.663376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 338/647] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:38.077486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-330348e9-82e1-444f-a47c-4b3a7a6443cc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:38.078409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-330348e9-82e1-444f-a47c-4b3a7a6443cc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:38.084901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-330348e9-82e1-444f-a47c-4b3a7a6443cc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:38.085355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-330348e9-82e1-444f-a47c-4b3a7a6443cc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:38.086384 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-330348e9-82e1-444f-a47c-4b3a7a6443cc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:38.086827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-330348e9-82e1-444f-a47c-4b3a7a6443cc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:38.116787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-330348e9-82e1-444f-a47c-4b3a7a6443cc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043158 Feb 21 00:43:38.117260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 310/648] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:38.317673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-01087b98-0e76-430a-8443-e1400b9f2643 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:38.318866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-01087b98-0e76-430a-8443-e1400b9f2643 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:38.327935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01087b98-0e76-430a-8443-e1400b9f2643 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:38.328551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01087b98-0e76-430a-8443-e1400b9f2643 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:38.329205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01087b98-0e76-430a-8443-e1400b9f2643 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:38.329608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01087b98-0e76-430a-8443-e1400b9f2643 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:38.397691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-01087b98-0e76-430a-8443-e1400b9f2643 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:38.406159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-01087b98-0e76-430a-8443-e1400b9f2643 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.094644 Feb 21 00:43:38.406719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 339/649] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:38 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:38.683543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2ca33c28-407a-4c8c-8241-d14be2d11579 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:38.684462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2ca33c28-407a-4c8c-8241-d14be2d11579 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:38.693338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ca33c28-407a-4c8c-8241-d14be2d11579 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:38.693890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ca33c28-407a-4c8c-8241-d14be2d11579 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:38.695515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ca33c28-407a-4c8c-8241-d14be2d11579 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:38.696067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ca33c28-407a-4c8c-8241-d14be2d11579 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:38.854189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2ca33c28-407a-4c8c-8241-d14be2d11579 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:38.861985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2ca33c28-407a-4c8c-8241-d14be2d11579 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.184670 Feb 21 00:43:38.862559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 311/650] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:38 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:39.132447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c5c13e72-b96c-4a0c-8c0c-748d7875c437 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:39.134033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c5c13e72-b96c-4a0c-8c0c-748d7875c437 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:39.141630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c5c13e72-b96c-4a0c-8c0c-748d7875c437 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:39.142070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c5c13e72-b96c-4a0c-8c0c-748d7875c437 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:39.142842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c5c13e72-b96c-4a0c-8c0c-748d7875c437 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:39.143267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c5c13e72-b96c-4a0c-8c0c-748d7875c437 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:39.172981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c5c13e72-b96c-4a0c-8c0c-748d7875c437 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046861 Feb 21 00:43:39.173797 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 340/651] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:39.427879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e98ee829-5210-4103-8fad-b73698781152 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:39.428519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e98ee829-5210-4103-8fad-b73698781152 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:39.436171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e98ee829-5210-4103-8fad-b73698781152 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:39.436674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e98ee829-5210-4103-8fad-b73698781152 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:39.437419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e98ee829-5210-4103-8fad-b73698781152 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:39.437842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e98ee829-5210-4103-8fad-b73698781152 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:39.496694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e98ee829-5210-4103-8fad-b73698781152 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:39.504499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e98ee829-5210-4103-8fad-b73698781152 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080788 Feb 21 00:43:39.505081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 312/652] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:39 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:39.882772 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-779d141f-a696-4edf-a17c-09a4ba0da03c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:39.883775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-779d141f-a696-4edf-a17c-09a4ba0da03c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:39.891903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-779d141f-a696-4edf-a17c-09a4ba0da03c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:39.892357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-779d141f-a696-4edf-a17c-09a4ba0da03c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:39.893196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-779d141f-a696-4edf-a17c-09a4ba0da03c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:39.893635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-779d141f-a696-4edf-a17c-09a4ba0da03c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:40.030813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-779d141f-a696-4edf-a17c-09a4ba0da03c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:40.038179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-779d141f-a696-4edf-a17c-09a4ba0da03c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161606 Feb 21 00:43:40.038739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 341/653] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:39 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:40.189273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e593f858-4646-40a1-a9fa-9ad4897bf0fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:40.190693 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e593f858-4646-40a1-a9fa-9ad4897bf0fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:40.201492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e593f858-4646-40a1-a9fa-9ad4897bf0fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:40.202202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e593f858-4646-40a1-a9fa-9ad4897bf0fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:40.203493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e593f858-4646-40a1-a9fa-9ad4897bf0fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:40.204213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e593f858-4646-40a1-a9fa-9ad4897bf0fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:40.238514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e593f858-4646-40a1-a9fa-9ad4897bf0fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055968 Feb 21 00:43:40.239068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 313/654] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:40 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:40.521723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0192c13a-4f38-45c8-9867-e64fa18aa070 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:40.522698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0192c13a-4f38-45c8-9867-e64fa18aa070 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:40.529053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0192c13a-4f38-45c8-9867-e64fa18aa070 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:40.529475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0192c13a-4f38-45c8-9867-e64fa18aa070 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:40.530560 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0192c13a-4f38-45c8-9867-e64fa18aa070 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:40.530987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0192c13a-4f38-45c8-9867-e64fa18aa070 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:40.596081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0192c13a-4f38-45c8-9867-e64fa18aa070 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:40.603633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0192c13a-4f38-45c8-9867-e64fa18aa070 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.086093 Feb 21 00:43:40.604187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 342/655] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:40 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:41.059034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-654f7f94-6b34-42e9-adad-3890f03f90a0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:41.059785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-654f7f94-6b34-42e9-adad-3890f03f90a0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:41.067134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-654f7f94-6b34-42e9-adad-3890f03f90a0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:41.067660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-654f7f94-6b34-42e9-adad-3890f03f90a0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:41.068613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-654f7f94-6b34-42e9-adad-3890f03f90a0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:41.069113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-654f7f94-6b34-42e9-adad-3890f03f90a0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:41.220926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-654f7f94-6b34-42e9-adad-3890f03f90a0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:41.228975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-654f7f94-6b34-42e9-adad-3890f03f90a0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.176246 Feb 21 00:43:41.229514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 314/656] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:41.249345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0d440470-2552-4e37-9db1-1883290754ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:41.250253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0d440470-2552-4e37-9db1-1883290754ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:41.256931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d440470-2552-4e37-9db1-1883290754ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:41.257375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d440470-2552-4e37-9db1-1883290754ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:41.258147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d440470-2552-4e37-9db1-1883290754ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:41.258574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d440470-2552-4e37-9db1-1883290754ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:41.288696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0d440470-2552-4e37-9db1-1883290754ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043022 Feb 21 00:43:41.289258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 343/657] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:41 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:41.624238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-964a8939-c09c-4a20-a53f-818b5f3d16cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:41.625292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-964a8939-c09c-4a20-a53f-818b5f3d16cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:41.635439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-964a8939-c09c-4a20-a53f-818b5f3d16cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:41.636173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-964a8939-c09c-4a20-a53f-818b5f3d16cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:41.637509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-964a8939-c09c-4a20-a53f-818b5f3d16cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:41.638540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-964a8939-c09c-4a20-a53f-818b5f3d16cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:41.704414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-964a8939-c09c-4a20-a53f-818b5f3d16cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:41.712196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-964a8939-c09c-4a20-a53f-818b5f3d16cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.094239 Feb 21 00:43:41.712797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 315/658] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:41 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:42.250022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5bcc7b30-0cc1-4ce3-9048-5bdc000144cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:42.251057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5bcc7b30-0cc1-4ce3-9048-5bdc000144cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:42.261874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bcc7b30-0cc1-4ce3-9048-5bdc000144cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:42.262422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bcc7b30-0cc1-4ce3-9048-5bdc000144cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:42.263191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bcc7b30-0cc1-4ce3-9048-5bdc000144cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:42.263614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bcc7b30-0cc1-4ce3-9048-5bdc000144cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:42.300438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3d025f7b-dfad-4f82-be9b-6ddf78d389f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:42.301371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3d025f7b-dfad-4f82-be9b-6ddf78d389f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:42.307561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d025f7b-dfad-4f82-be9b-6ddf78d389f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:42.307975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d025f7b-dfad-4f82-be9b-6ddf78d389f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:42.310189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d025f7b-dfad-4f82-be9b-6ddf78d389f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:42.310189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d025f7b-dfad-4f82-be9b-6ddf78d389f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:42.340465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3d025f7b-dfad-4f82-be9b-6ddf78d389f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043751 Feb 21 00:43:42.341271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 316/659] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:42.409879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5bcc7b30-0cc1-4ce3-9048-5bdc000144cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:42.421206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5bcc7b30-0cc1-4ce3-9048-5bdc000144cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.176983 Feb 21 00:43:42.421988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 344/660] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:42 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:42.732201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b404fd7d-baf4-4354-8691-92c50ad0fb99 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:42.732858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b404fd7d-baf4-4354-8691-92c50ad0fb99 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:42.739199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b404fd7d-baf4-4354-8691-92c50ad0fb99 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:42.739660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b404fd7d-baf4-4354-8691-92c50ad0fb99 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:42.740479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b404fd7d-baf4-4354-8691-92c50ad0fb99 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:42.740907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b404fd7d-baf4-4354-8691-92c50ad0fb99 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:42.803730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b404fd7d-baf4-4354-8691-92c50ad0fb99 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:42.811668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b404fd7d-baf4-4354-8691-92c50ad0fb99 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.084812 Feb 21 00:43:42.812254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 317/661] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:42 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:43.356263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2b13619f-fe9b-4a66-bb13-12fd582fc257 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:43.357807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2b13619f-fe9b-4a66-bb13-12fd582fc257 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:43.368434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b13619f-fe9b-4a66-bb13-12fd582fc257 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:43.369189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b13619f-fe9b-4a66-bb13-12fd582fc257 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:43.370463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b13619f-fe9b-4a66-bb13-12fd582fc257 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:43.371157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b13619f-fe9b-4a66-bb13-12fd582fc257 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:43.400846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2b13619f-fe9b-4a66-bb13-12fd582fc257 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051068 Feb 21 00:43:43.401395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 345/662] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:43.446816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6c14368b-01f3-4e5a-bbbc-d7ee16f82520 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:43.447809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6c14368b-01f3-4e5a-bbbc-d7ee16f82520 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:43.459027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c14368b-01f3-4e5a-bbbc-d7ee16f82520 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:43.459757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c14368b-01f3-4e5a-bbbc-d7ee16f82520 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:43.461316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c14368b-01f3-4e5a-bbbc-d7ee16f82520 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:43.462112 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c14368b-01f3-4e5a-bbbc-d7ee16f82520 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:43.606850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6c14368b-01f3-4e5a-bbbc-d7ee16f82520 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:43.614263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6c14368b-01f3-4e5a-bbbc-d7ee16f82520 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.174204 Feb 21 00:43:43.614834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 318/663] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:43 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:43.836615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3c1af7e6-8301-43df-93e6-b0ac4dfdb01c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:43.837601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3c1af7e6-8301-43df-93e6-b0ac4dfdb01c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:43.844848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3c1af7e6-8301-43df-93e6-b0ac4dfdb01c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:43.845292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3c1af7e6-8301-43df-93e6-b0ac4dfdb01c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:43.846046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3c1af7e6-8301-43df-93e6-b0ac4dfdb01c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:43.846467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3c1af7e6-8301-43df-93e6-b0ac4dfdb01c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:43.905612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3c1af7e6-8301-43df-93e6-b0ac4dfdb01c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:43.913111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3c1af7e6-8301-43df-93e6-b0ac4dfdb01c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.082776 Feb 21 00:43:43.913665 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 346/664] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:43 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:44.416816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c6cd6d0e-339e-493b-bb56-fea2151ec1df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:44.418555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c6cd6d0e-339e-493b-bb56-fea2151ec1df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:44.425920 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d0e-339e-493b-bb56-fea2151ec1df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:44.426439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d0e-339e-493b-bb56-fea2151ec1df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:44.427385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d0e-339e-493b-bb56-fea2151ec1df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:44.427885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d0e-339e-493b-bb56-fea2151ec1df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:44.460698 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c6cd6d0e-339e-493b-bb56-fea2151ec1df tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050346 Feb 21 00:43:44.461329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 319/665] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:44 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:44.635327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-abef91d1-3839-4ef4-a707-446b63dd08fe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:44.636326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-abef91d1-3839-4ef4-a707-446b63dd08fe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:44.646920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-abef91d1-3839-4ef4-a707-446b63dd08fe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:44.647651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-abef91d1-3839-4ef4-a707-446b63dd08fe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:44.649066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-abef91d1-3839-4ef4-a707-446b63dd08fe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:44.649764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-abef91d1-3839-4ef4-a707-446b63dd08fe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:44.790916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-abef91d1-3839-4ef4-a707-446b63dd08fe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:44.798967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-abef91d1-3839-4ef4-a707-446b63dd08fe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.169756 Feb 21 00:43:44.799537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 347/666] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:44 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:44.932752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-03a26a9f-6346-4282-b51c-a0a5a3b36d4a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:44.933846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-03a26a9f-6346-4282-b51c-a0a5a3b36d4a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:44.940597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-03a26a9f-6346-4282-b51c-a0a5a3b36d4a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:44.941051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-03a26a9f-6346-4282-b51c-a0a5a3b36d4a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:44.941829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-03a26a9f-6346-4282-b51c-a0a5a3b36d4a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:44.942263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-03a26a9f-6346-4282-b51c-a0a5a3b36d4a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:45.003877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-03a26a9f-6346-4282-b51c-a0a5a3b36d4a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:45.012125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-03a26a9f-6346-4282-b51c-a0a5a3b36d4a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.085504 Feb 21 00:43:45.012740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 320/667] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:44 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:45.476709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-54776bbe-5f32-4307-9c9b-c284dbe7163b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:45.478192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-54776bbe-5f32-4307-9c9b-c284dbe7163b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:45.488449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54776bbe-5f32-4307-9c9b-c284dbe7163b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:45.489239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54776bbe-5f32-4307-9c9b-c284dbe7163b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:45.490554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54776bbe-5f32-4307-9c9b-c284dbe7163b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:45.491279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54776bbe-5f32-4307-9c9b-c284dbe7163b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:45.534689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-54776bbe-5f32-4307-9c9b-c284dbe7163b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064404 Feb 21 00:43:45.535597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 348/668] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:45 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:45.819821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ae1e56f7-4205-4953-89e1-24e916f669bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:45.820916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ae1e56f7-4205-4953-89e1-24e916f669bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:45.828881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae1e56f7-4205-4953-89e1-24e916f669bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:45.829323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae1e56f7-4205-4953-89e1-24e916f669bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:45.830095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae1e56f7-4205-4953-89e1-24e916f669bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:45.830524 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae1e56f7-4205-4953-89e1-24e916f669bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:45.977836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ae1e56f7-4205-4953-89e1-24e916f669bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:45.986025 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ae1e56f7-4205-4953-89e1-24e916f669bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.172529 Feb 21 00:43:45.986595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 321/669] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:45 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:46.033436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-32facea6-1853-467e-b242-c81aae8875e6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:46.034009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-32facea6-1853-467e-b242-c81aae8875e6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:46.040769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-32facea6-1853-467e-b242-c81aae8875e6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:46.041211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-32facea6-1853-467e-b242-c81aae8875e6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:46.041970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-32facea6-1853-467e-b242-c81aae8875e6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:46.042392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-32facea6-1853-467e-b242-c81aae8875e6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:46.105443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-32facea6-1853-467e-b242-c81aae8875e6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:46.116982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-32facea6-1853-467e-b242-c81aae8875e6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.087204 Feb 21 00:43:46.117760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 349/670] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:46 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:46.548335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e3cc4103-4e2a-4837-8d5a-1f7fbe9dfced tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:46.549477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e3cc4103-4e2a-4837-8d5a-1f7fbe9dfced tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:46.555606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e3cc4103-4e2a-4837-8d5a-1f7fbe9dfced tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:46.556040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e3cc4103-4e2a-4837-8d5a-1f7fbe9dfced tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:46.556860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e3cc4103-4e2a-4837-8d5a-1f7fbe9dfced tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:46.557281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e3cc4103-4e2a-4837-8d5a-1f7fbe9dfced tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:46.585846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e3cc4103-4e2a-4837-8d5a-1f7fbe9dfced tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041322 Feb 21 00:43:46.586396 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 322/671] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:47.011533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3de4f31c-5d85-41b1-8a3b-6c70f19a51aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:47.014085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3de4f31c-5d85-41b1-8a3b-6c70f19a51aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:47.024542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3de4f31c-5d85-41b1-8a3b-6c70f19a51aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:47.025234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3de4f31c-5d85-41b1-8a3b-6c70f19a51aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:47.026496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3de4f31c-5d85-41b1-8a3b-6c70f19a51aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:47.027199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3de4f31c-5d85-41b1-8a3b-6c70f19a51aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:47.135068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3ebecbb6-b02c-4590-af3f-0e877360f3ba tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:47.135642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3ebecbb6-b02c-4590-af3f-0e877360f3ba tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:47.142128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ebecbb6-b02c-4590-af3f-0e877360f3ba tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:47.142581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ebecbb6-b02c-4590-af3f-0e877360f3ba tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:47.143359 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ebecbb6-b02c-4590-af3f-0e877360f3ba tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:47.143796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ebecbb6-b02c-4590-af3f-0e877360f3ba tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:47.166297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3de4f31c-5d85-41b1-8a3b-6c70f19a51aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:47.174150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3de4f31c-5d85-41b1-8a3b-6c70f19a51aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.168618 Feb 21 00:43:47.174684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 350/672] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:47.204515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3ebecbb6-b02c-4590-af3f-0e877360f3ba tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:47.212157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3ebecbb6-b02c-4590-af3f-0e877360f3ba tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080934 Feb 21 00:43:47.212756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 323/673] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:47 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:47.600624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f6847d77-cecc-4386-a2e6-751b9e2133c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:47.601851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f6847d77-cecc-4386-a2e6-751b9e2133c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:47.610431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6847d77-cecc-4386-a2e6-751b9e2133c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:47.611015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6847d77-cecc-4386-a2e6-751b9e2133c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:47.612361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6847d77-cecc-4386-a2e6-751b9e2133c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:47.612633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6847d77-cecc-4386-a2e6-751b9e2133c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:47.655577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f6847d77-cecc-4386-a2e6-751b9e2133c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059795 Feb 21 00:43:47.656143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 351/674] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:47 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:48.197848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9c870053-156e-4e64-a74a-3841ec148889 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:48.198805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9c870053-156e-4e64-a74a-3841ec148889 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:48.206077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c870053-156e-4e64-a74a-3841ec148889 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:48.206519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c870053-156e-4e64-a74a-3841ec148889 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:48.207298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c870053-156e-4e64-a74a-3841ec148889 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:48.207727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c870053-156e-4e64-a74a-3841ec148889 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:48.231417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-00fed4f3-fde2-43aa-951a-51b262006d15 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:48.232175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-00fed4f3-fde2-43aa-951a-51b262006d15 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:48.238715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-00fed4f3-fde2-43aa-951a-51b262006d15 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:48.239161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-00fed4f3-fde2-43aa-951a-51b262006d15 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:48.239938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-00fed4f3-fde2-43aa-951a-51b262006d15 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:48.240362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-00fed4f3-fde2-43aa-951a-51b262006d15 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:48.305102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-00fed4f3-fde2-43aa-951a-51b262006d15 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:48.312716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-00fed4f3-fde2-43aa-951a-51b262006d15 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.086387 Feb 21 00:43:48.313261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 352/675] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:48 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:48.349456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9c870053-156e-4e64-a74a-3841ec148889 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:48.361167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9c870053-156e-4e64-a74a-3841ec148889 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.171180 Feb 21 00:43:48.361993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 324/676] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:48 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:48.671605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f8c8e1e4-a0eb-4292-9192-dfb43b86bbb5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:48.673163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f8c8e1e4-a0eb-4292-9192-dfb43b86bbb5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:48.683367 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8c8e1e4-a0eb-4292-9192-dfb43b86bbb5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:48.683981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8c8e1e4-a0eb-4292-9192-dfb43b86bbb5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:48.684793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8c8e1e4-a0eb-4292-9192-dfb43b86bbb5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:48.685212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8c8e1e4-a0eb-4292-9192-dfb43b86bbb5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:48.715490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f8c8e1e4-a0eb-4292-9192-dfb43b86bbb5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050348 Feb 21 00:43:48.716057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 353/677] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:49.333040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9de855db-2fae-4792-b7fa-1d1bbbd85add tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:49.334029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9de855db-2fae-4792-b7fa-1d1bbbd85add tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:49.342986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9de855db-2fae-4792-b7fa-1d1bbbd85add tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:49.343426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9de855db-2fae-4792-b7fa-1d1bbbd85add tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:49.344193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9de855db-2fae-4792-b7fa-1d1bbbd85add tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:49.344665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9de855db-2fae-4792-b7fa-1d1bbbd85add tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:49.378395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d96251b0-2926-4638-b57e-3a93443098b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:49.379105 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d96251b0-2926-4638-b57e-3a93443098b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:49.385933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d96251b0-2926-4638-b57e-3a93443098b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:49.386371 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d96251b0-2926-4638-b57e-3a93443098b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:49.387151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d96251b0-2926-4638-b57e-3a93443098b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:49.387575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d96251b0-2926-4638-b57e-3a93443098b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:49.407882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9de855db-2fae-4792-b7fa-1d1bbbd85add tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:49.415549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9de855db-2fae-4792-b7fa-1d1bbbd85add tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.088744 Feb 21 00:43:49.416109 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 325/678] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:49 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:49.525594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d96251b0-2926-4638-b57e-3a93443098b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:49.535179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d96251b0-2926-4638-b57e-3a93443098b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.160336 Feb 21 00:43:49.535980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 354/679] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:49 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:49.728745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3d53010b-47ca-4834-b5ef-f4a9b253266a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:49.729654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3d53010b-47ca-4834-b5ef-f4a9b253266a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:49.736983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d53010b-47ca-4834-b5ef-f4a9b253266a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:49.737503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d53010b-47ca-4834-b5ef-f4a9b253266a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:49.738379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d53010b-47ca-4834-b5ef-f4a9b253266a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:49.738877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d53010b-47ca-4834-b5ef-f4a9b253266a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:49.771917 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3d53010b-47ca-4834-b5ef-f4a9b253266a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047532 Feb 21 00:43:49.772477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 326/680] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:50.436099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-787a8970-9c44-4a78-9b4a-d7be4ba6678a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:50.437133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-787a8970-9c44-4a78-9b4a-d7be4ba6678a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:50.447654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-787a8970-9c44-4a78-9b4a-d7be4ba6678a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:50.448383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-787a8970-9c44-4a78-9b4a-d7be4ba6678a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:50.449598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-787a8970-9c44-4a78-9b4a-d7be4ba6678a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:50.450068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-787a8970-9c44-4a78-9b4a-d7be4ba6678a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:50.509672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-787a8970-9c44-4a78-9b4a-d7be4ba6678a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:50.517230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-787a8970-9c44-4a78-9b4a-d7be4ba6678a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.087126 Feb 21 00:43:50.517837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 355/681] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:50 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:50.552420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-521aca62-18f4-40f5-973a-40766e1bd6de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:50.553040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-521aca62-18f4-40f5-973a-40766e1bd6de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:50.559764 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-521aca62-18f4-40f5-973a-40766e1bd6de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:50.560207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-521aca62-18f4-40f5-973a-40766e1bd6de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:50.561012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-521aca62-18f4-40f5-973a-40766e1bd6de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:50.561439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-521aca62-18f4-40f5-973a-40766e1bd6de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:50.718034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-521aca62-18f4-40f5-973a-40766e1bd6de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:50.730065 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-521aca62-18f4-40f5-973a-40766e1bd6de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.180984 Feb 21 00:43:50.730823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 327/682] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:50 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:50.787831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0505effb-b2c6-4aeb-8e5b-d8b554eb2692 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:50.789345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0505effb-b2c6-4aeb-8e5b-d8b554eb2692 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:50.799030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0505effb-b2c6-4aeb-8e5b-d8b554eb2692 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:50.799761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0505effb-b2c6-4aeb-8e5b-d8b554eb2692 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:50.801055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0505effb-b2c6-4aeb-8e5b-d8b554eb2692 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:50.801768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0505effb-b2c6-4aeb-8e5b-d8b554eb2692 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:50.833744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0505effb-b2c6-4aeb-8e5b-d8b554eb2692 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052309 Feb 21 00:43:50.834285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 356/683] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:50 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:51.534789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e27c3400-590a-41f6-96be-217cd711270e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:51.535390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e27c3400-590a-41f6-96be-217cd711270e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:51.542057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e27c3400-590a-41f6-96be-217cd711270e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:51.542494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e27c3400-590a-41f6-96be-217cd711270e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:51.543253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e27c3400-590a-41f6-96be-217cd711270e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:51.543677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e27c3400-590a-41f6-96be-217cd711270e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:51.604382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e27c3400-590a-41f6-96be-217cd711270e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:51.611814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e27c3400-590a-41f6-96be-217cd711270e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080688 Feb 21 00:43:51.612370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 328/684] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:51 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:51.757013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-180e86aa-ae49-4d7e-b18e-a6ce227471a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:51.757897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-180e86aa-ae49-4d7e-b18e-a6ce227471a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:51.766154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-180e86aa-ae49-4d7e-b18e-a6ce227471a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:51.766663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-180e86aa-ae49-4d7e-b18e-a6ce227471a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:51.767538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-180e86aa-ae49-4d7e-b18e-a6ce227471a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:51.768025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-180e86aa-ae49-4d7e-b18e-a6ce227471a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:51.845842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-52850bf9-c478-4619-8e5d-445f38d62705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:51.846694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-52850bf9-c478-4619-8e5d-445f38d62705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:51.852911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52850bf9-c478-4619-8e5d-445f38d62705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:51.853349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52850bf9-c478-4619-8e5d-445f38d62705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:51.854118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52850bf9-c478-4619-8e5d-445f38d62705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:51.854541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52850bf9-c478-4619-8e5d-445f38d62705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:51.884833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-52850bf9-c478-4619-8e5d-445f38d62705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042794 Feb 21 00:43:51.885387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 329/685] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:51 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:51.915891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-180e86aa-ae49-4d7e-b18e-a6ce227471a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:51.923598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-180e86aa-ae49-4d7e-b18e-a6ce227471a1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.172613 Feb 21 00:43:51.924172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 357/686] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:52.632290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1705841c-c030-44ff-8c14-ba7aa40351cf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:52.633389 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1705841c-c030-44ff-8c14-ba7aa40351cf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:52.641255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1705841c-c030-44ff-8c14-ba7aa40351cf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:52.641698 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1705841c-c030-44ff-8c14-ba7aa40351cf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:52.642467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1705841c-c030-44ff-8c14-ba7aa40351cf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:52.642895 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1705841c-c030-44ff-8c14-ba7aa40351cf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:52.703460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1705841c-c030-44ff-8c14-ba7aa40351cf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:52.710914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1705841c-c030-44ff-8c14-ba7aa40351cf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.084671 Feb 21 00:43:52.711465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 330/687] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:52 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:52.901117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5cd3cc7c-4546-4e90-b436-f262a0495a07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:52.902392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5cd3cc7c-4546-4e90-b436-f262a0495a07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:52.909692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5cd3cc7c-4546-4e90-b436-f262a0495a07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:52.910156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5cd3cc7c-4546-4e90-b436-f262a0495a07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:52.910961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5cd3cc7c-4546-4e90-b436-f262a0495a07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:52.911407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5cd3cc7c-4546-4e90-b436-f262a0495a07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:52.940461 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-229940a9-605c-44c3-936a-fb97edfbbd3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:52.941082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-229940a9-605c-44c3-936a-fb97edfbbd3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:52.941882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5cd3cc7c-4546-4e90-b436-f262a0495a07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047658 Feb 21 00:43:52.942456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 358/688] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:52.947168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-229940a9-605c-44c3-936a-fb97edfbbd3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:52.947611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-229940a9-605c-44c3-936a-fb97edfbbd3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:52.948410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-229940a9-605c-44c3-936a-fb97edfbbd3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:52.948837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-229940a9-605c-44c3-936a-fb97edfbbd3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:53.083690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-229940a9-605c-44c3-936a-fb97edfbbd3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:53.091738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-229940a9-605c-44c3-936a-fb97edfbbd3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.155025 Feb 21 00:43:53.092335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 331/689] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:53.731552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-67eac4cc-ef67-4e90-9c69-3fe7cb7e997b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:53.732585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-67eac4cc-ef67-4e90-9c69-3fe7cb7e997b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:53.742618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67eac4cc-ef67-4e90-9c69-3fe7cb7e997b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:53.743339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67eac4cc-ef67-4e90-9c69-3fe7cb7e997b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:53.744600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67eac4cc-ef67-4e90-9c69-3fe7cb7e997b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:53.745344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67eac4cc-ef67-4e90-9c69-3fe7cb7e997b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:53.804718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-67eac4cc-ef67-4e90-9c69-3fe7cb7e997b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:53.812246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-67eac4cc-ef67-4e90-9c69-3fe7cb7e997b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.086746 Feb 21 00:43:53.812838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 359/690] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:53 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:53.957368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-137de1a4-60d1-452e-8e7c-093ba1bddcb7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:53.958859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-137de1a4-60d1-452e-8e7c-093ba1bddcb7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:53.967656 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-137de1a4-60d1-452e-8e7c-093ba1bddcb7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:53.968092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-137de1a4-60d1-452e-8e7c-093ba1bddcb7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:53.968897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-137de1a4-60d1-452e-8e7c-093ba1bddcb7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:53.969317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-137de1a4-60d1-452e-8e7c-093ba1bddcb7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:54.000117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-137de1a4-60d1-452e-8e7c-093ba1bddcb7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049086 Feb 21 00:43:54.000706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 332/691] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:53 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:54.117437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-15dcfbe3-d5f3-4990-914d-1165af4ce857 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:54.118247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-15dcfbe3-d5f3-4990-914d-1165af4ce857 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:54.128666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15dcfbe3-d5f3-4990-914d-1165af4ce857 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:54.129403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15dcfbe3-d5f3-4990-914d-1165af4ce857 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:54.130676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15dcfbe3-d5f3-4990-914d-1165af4ce857 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:54.131387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15dcfbe3-d5f3-4990-914d-1165af4ce857 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:54.279361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-15dcfbe3-d5f3-4990-914d-1165af4ce857 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:54.287561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-15dcfbe3-d5f3-4990-914d-1165af4ce857 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.176478 Feb 21 00:43:54.288139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 360/692] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:54 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:54.830663 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e70f43d4-2b48-429f-a0c1-5a54d98dcb6c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:54.832512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e70f43d4-2b48-429f-a0c1-5a54d98dcb6c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:54.838574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e70f43d4-2b48-429f-a0c1-5a54d98dcb6c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:54.839018 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e70f43d4-2b48-429f-a0c1-5a54d98dcb6c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:54.839804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e70f43d4-2b48-429f-a0c1-5a54d98dcb6c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:54.840204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e70f43d4-2b48-429f-a0c1-5a54d98dcb6c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:54.909146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e70f43d4-2b48-429f-a0c1-5a54d98dcb6c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:54.920493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e70f43d4-2b48-429f-a0c1-5a54d98dcb6c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.094759 Feb 21 00:43:54.921057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 333/693] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:54 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:55.017916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f862c12c-e10e-4ff9-a24a-b6c4bbf5b7b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:55.019372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f862c12c-e10e-4ff9-a24a-b6c4bbf5b7b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:55.029640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f862c12c-e10e-4ff9-a24a-b6c4bbf5b7b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:55.030710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f862c12c-e10e-4ff9-a24a-b6c4bbf5b7b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:55.031981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f862c12c-e10e-4ff9-a24a-b6c4bbf5b7b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:55.032753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f862c12c-e10e-4ff9-a24a-b6c4bbf5b7b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:55.066283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f862c12c-e10e-4ff9-a24a-b6c4bbf5b7b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054741 Feb 21 00:43:55.066730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 361/694] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:55.308627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a09372e8-bef8-4659-a3dd-7c060a4fb043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:55.309343 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a09372e8-bef8-4659-a3dd-7c060a4fb043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:55.317572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a09372e8-bef8-4659-a3dd-7c060a4fb043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:55.318071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a09372e8-bef8-4659-a3dd-7c060a4fb043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:55.318993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a09372e8-bef8-4659-a3dd-7c060a4fb043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:55.319522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a09372e8-bef8-4659-a3dd-7c060a4fb043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:55.461140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a09372e8-bef8-4659-a3dd-7c060a4fb043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:55.468446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a09372e8-bef8-4659-a3dd-7c060a4fb043 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.166003 Feb 21 00:43:55.469122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 334/695] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:55.941372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-64484311-6707-46da-ba7d-3d7f108f311d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:55.942300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-64484311-6707-46da-ba7d-3d7f108f311d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:55.952939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64484311-6707-46da-ba7d-3d7f108f311d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:55.953679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64484311-6707-46da-ba7d-3d7f108f311d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:55.954958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64484311-6707-46da-ba7d-3d7f108f311d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:55.955675 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64484311-6707-46da-ba7d-3d7f108f311d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:56.025044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-64484311-6707-46da-ba7d-3d7f108f311d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:56.032774 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-64484311-6707-46da-ba7d-3d7f108f311d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.097572 Feb 21 00:43:56.033348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 362/696] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:55 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:56.077980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f50689c9-6f83-430a-aebb-06abb3a2e2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:56.078893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f50689c9-6f83-430a-aebb-06abb3a2e2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:56.085179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f50689c9-6f83-430a-aebb-06abb3a2e2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:56.085620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f50689c9-6f83-430a-aebb-06abb3a2e2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:56.086392 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f50689c9-6f83-430a-aebb-06abb3a2e2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:56.086819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f50689c9-6f83-430a-aebb-06abb3a2e2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:56.115966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f50689c9-6f83-430a-aebb-06abb3a2e2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041838 Feb 21 00:43:56.116542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 335/697] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:56 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:56.493708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1d6e9325-9faf-4136-92fa-c20ac4134b66 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:56.494823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1d6e9325-9faf-4136-92fa-c20ac4134b66 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:56.504938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1d6e9325-9faf-4136-92fa-c20ac4134b66 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:56.505664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1d6e9325-9faf-4136-92fa-c20ac4134b66 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:56.506922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1d6e9325-9faf-4136-92fa-c20ac4134b66 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:56.507641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1d6e9325-9faf-4136-92fa-c20ac4134b66 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:56.667491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1d6e9325-9faf-4136-92fa-c20ac4134b66 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:56.678599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1d6e9325-9faf-4136-92fa-c20ac4134b66 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.190821 Feb 21 00:43:56.679322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 363/698] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:57.049350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f87d34f0-6baa-45a2-bfef-243312b84e73 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:57.049967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f87d34f0-6baa-45a2-bfef-243312b84e73 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:57.056505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f87d34f0-6baa-45a2-bfef-243312b84e73 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:57.056957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f87d34f0-6baa-45a2-bfef-243312b84e73 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:57.057739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f87d34f0-6baa-45a2-bfef-243312b84e73 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:57.058203 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f87d34f0-6baa-45a2-bfef-243312b84e73 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:57.117593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f87d34f0-6baa-45a2-bfef-243312b84e73 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:57.125459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f87d34f0-6baa-45a2-bfef-243312b84e73 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.079869 Feb 21 00:43:57.126143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 336/699] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:57 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:57.129158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-506ee16d-326c-4b58-b449-596d61430022 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:57.130064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-506ee16d-326c-4b58-b449-596d61430022 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:57.136657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-506ee16d-326c-4b58-b449-596d61430022 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:57.137103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-506ee16d-326c-4b58-b449-596d61430022 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:57.137872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-506ee16d-326c-4b58-b449-596d61430022 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:57.138294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-506ee16d-326c-4b58-b449-596d61430022 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:57.166980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-506ee16d-326c-4b58-b449-596d61430022 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041643 Feb 21 00:43:57.167584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 364/700] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:57 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:57.699514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b89f8e32-0b18-49f7-8521-a6b1f6500ce1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:57.700564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b89f8e32-0b18-49f7-8521-a6b1f6500ce1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:57.710540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b89f8e32-0b18-49f7-8521-a6b1f6500ce1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:57.711264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b89f8e32-0b18-49f7-8521-a6b1f6500ce1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:57.712548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b89f8e32-0b18-49f7-8521-a6b1f6500ce1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:57.713294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b89f8e32-0b18-49f7-8521-a6b1f6500ce1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:57.849007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b89f8e32-0b18-49f7-8521-a6b1f6500ce1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:57.857003 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b89f8e32-0b18-49f7-8521-a6b1f6500ce1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.163560 Feb 21 00:43:57.857552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 337/701] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:58.146676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-095db2e1-a75c-41ce-b285-59abeac0e544 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:58.147767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-095db2e1-a75c-41ce-b285-59abeac0e544 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:58.155989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-095db2e1-a75c-41ce-b285-59abeac0e544 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:58.156427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-095db2e1-a75c-41ce-b285-59abeac0e544 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:58.157264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-095db2e1-a75c-41ce-b285-59abeac0e544 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:58.157690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-095db2e1-a75c-41ce-b285-59abeac0e544 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:58.179178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-73402d17-74e2-495c-a55e-c1d3630e11a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:58.180095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-73402d17-74e2-495c-a55e-c1d3630e11a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:58.186372 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73402d17-74e2-495c-a55e-c1d3630e11a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:58.186817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73402d17-74e2-495c-a55e-c1d3630e11a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:58.187591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73402d17-74e2-495c-a55e-c1d3630e11a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:58.188020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73402d17-74e2-495c-a55e-c1d3630e11a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:58.216891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-73402d17-74e2-495c-a55e-c1d3630e11a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041601 Feb 21 00:43:58.217409 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-095db2e1-a75c-41ce-b285-59abeac0e544 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:58.217593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 338/702] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:58.224850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-095db2e1-a75c-41ce-b285-59abeac0e544 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.084707 Feb 21 00:43:58.225453 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 365/703] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:58 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:58.877183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-89ada390-b9cf-4d20-bd25-6a85ff5d1a07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:58.878044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-89ada390-b9cf-4d20-bd25-6a85ff5d1a07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:58.887984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89ada390-b9cf-4d20-bd25-6a85ff5d1a07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:58.888782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89ada390-b9cf-4d20-bd25-6a85ff5d1a07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:58.890037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89ada390-b9cf-4d20-bd25-6a85ff5d1a07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:58.890740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89ada390-b9cf-4d20-bd25-6a85ff5d1a07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:59.048237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-89ada390-b9cf-4d20-bd25-6a85ff5d1a07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:59.056781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-89ada390-b9cf-4d20-bd25-6a85ff5d1a07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.185866 Feb 21 00:43:59.057323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 339/704] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:58 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:43:59.231391 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c79ddfb4-5905-40de-a3aa-0c8d553b5fe8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:59.232305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c79ddfb4-5905-40de-a3aa-0c8d553b5fe8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:59.239023 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c79ddfb4-5905-40de-a3aa-0c8d553b5fe8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:59.239497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c79ddfb4-5905-40de-a3aa-0c8d553b5fe8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:59.240267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c79ddfb4-5905-40de-a3aa-0c8d553b5fe8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:59.240719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c79ddfb4-5905-40de-a3aa-0c8d553b5fe8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:59.241469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6b2e5d85-4ded-43d6-900f-5a6543048360 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:43:59.242102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6b2e5d85-4ded-43d6-900f-5a6543048360 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:43:59.248816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b2e5d85-4ded-43d6-900f-5a6543048360 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:59.249265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b2e5d85-4ded-43d6-900f-5a6543048360 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:59.250055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b2e5d85-4ded-43d6-900f-5a6543048360 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:43:59.250483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b2e5d85-4ded-43d6-900f-5a6543048360 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:43:59.273064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c79ddfb4-5905-40de-a3aa-0c8d553b5fe8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046424 Feb 21 00:43:59.273654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 366/705] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:43:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:43:59.312883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6b2e5d85-4ded-43d6-900f-5a6543048360 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:43:59.320254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6b2e5d85-4ded-43d6-900f-5a6543048360 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.082534 Feb 21 00:43:59.320860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 340/706] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:43:59 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:44:00.077912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cac1ac11-6ef2-4ad4-b005-769f5fbb8931 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:00.078905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cac1ac11-6ef2-4ad4-b005-769f5fbb8931 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:00.088971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cac1ac11-6ef2-4ad4-b005-769f5fbb8931 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:00.089707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cac1ac11-6ef2-4ad4-b005-769f5fbb8931 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:00.091038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cac1ac11-6ef2-4ad4-b005-769f5fbb8931 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:00.091748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cac1ac11-6ef2-4ad4-b005-769f5fbb8931 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:00.235713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cac1ac11-6ef2-4ad4-b005-769f5fbb8931 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:00.243893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cac1ac11-6ef2-4ad4-b005-769f5fbb8931 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.172283 Feb 21 00:44:00.244488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 367/707] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:00.285098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-af3e6dc5-0c4f-4053-b2ef-d8e1084ef838 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:00.285999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-af3e6dc5-0c4f-4053-b2ef-d8e1084ef838 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:00.292842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af3e6dc5-0c4f-4053-b2ef-d8e1084ef838 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:00.293283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af3e6dc5-0c4f-4053-b2ef-d8e1084ef838 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:00.294059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af3e6dc5-0c4f-4053-b2ef-d8e1084ef838 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:00.294480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af3e6dc5-0c4f-4053-b2ef-d8e1084ef838 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:00.325348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-af3e6dc5-0c4f-4053-b2ef-d8e1084ef838 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044061 Feb 21 00:44:00.325914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 341/708] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:00 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:00.339596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-58607312-0ed1-42f1-a369-ffb9e84d86bf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:00.340132 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-58607312-0ed1-42f1-a369-ffb9e84d86bf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:00.349379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-58607312-0ed1-42f1-a369-ffb9e84d86bf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:00.349816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-58607312-0ed1-42f1-a369-ffb9e84d86bf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:00.350582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-58607312-0ed1-42f1-a369-ffb9e84d86bf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:00.351008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-58607312-0ed1-42f1-a369-ffb9e84d86bf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:00.418181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-58607312-0ed1-42f1-a369-ffb9e84d86bf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:00.426104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-58607312-0ed1-42f1-a369-ffb9e84d86bf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.092697 Feb 21 00:44:00.426664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 368/709] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:00 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:01.268526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e34f2635-4ef9-4bf5-8ded-33b799c57675 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:01.269333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e34f2635-4ef9-4bf5-8ded-33b799c57675 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:01.278487 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e34f2635-4ef9-4bf5-8ded-33b799c57675 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:01.278937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e34f2635-4ef9-4bf5-8ded-33b799c57675 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:01.280022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e34f2635-4ef9-4bf5-8ded-33b799c57675 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:01.280493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e34f2635-4ef9-4bf5-8ded-33b799c57675 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:01.337254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-714d9486-c479-4e0b-92b0-ac1a5dc2a9a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:01.338169 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-714d9486-c479-4e0b-92b0-ac1a5dc2a9a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:01.344952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-714d9486-c479-4e0b-92b0-ac1a5dc2a9a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:01.345404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-714d9486-c479-4e0b-92b0-ac1a5dc2a9a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:01.346188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-714d9486-c479-4e0b-92b0-ac1a5dc2a9a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:01.346610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-714d9486-c479-4e0b-92b0-ac1a5dc2a9a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:01.376322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-714d9486-c479-4e0b-92b0-ac1a5dc2a9a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042892 Feb 21 00:44:01.376927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 369/710] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:01.423018 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e34f2635-4ef9-4bf5-8ded-33b799c57675 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:01.430876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e34f2635-4ef9-4bf5-8ded-33b799c57675 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.168272 Feb 21 00:44:01.431453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 342/711] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:01 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:01.442557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-40ef8d4d-74c9-430c-9d00-746ed87af2aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:01.443180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-40ef8d4d-74c9-430c-9d00-746ed87af2aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:01.449243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40ef8d4d-74c9-430c-9d00-746ed87af2aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:01.449684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40ef8d4d-74c9-430c-9d00-746ed87af2aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:01.450444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40ef8d4d-74c9-430c-9d00-746ed87af2aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:01.450866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40ef8d4d-74c9-430c-9d00-746ed87af2aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:01.522417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-40ef8d4d-74c9-430c-9d00-746ed87af2aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:01.531123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-40ef8d4d-74c9-430c-9d00-746ed87af2aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.092195 Feb 21 00:44:01.531708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 370/712] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:01 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:01.852828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f0a5df13-af8c-4b7f-9c91-6a95a7042fac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-778247797"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:44:01.853577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f0a5df13-af8c-4b7f-9c91-6a95a7042fac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:01.863723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0a5df13-af8c-4b7f-9c91-6a95a7042fac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:01.864479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0a5df13-af8c-4b7f-9c91-6a95a7042fac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:01.865773 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0a5df13-af8c-4b7f-9c91-6a95a7042fac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:01.866480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0a5df13-af8c-4b7f-9c91-6a95a7042fac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:02.007118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.network.security_group_api [None req-f0a5df13-af8c-4b7f-9c91-6a95a7042fac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Removing security group 83a66486-9401-4aeb-a5e3-6999eea89fc4 from port 01160744-2091-4d9b-9585-581bf4da5aa7 Feb 21 00:44:02.367708 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f0a5df13-af8c-4b7f-9c91-6a95a7042fac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "POST /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/action" status: 202 len: 0 microversion: 2.1 time: 0.521246 Feb 21 00:44:02.368332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 343/713] 10.222.0.72 () {60 vars in 1277 bytes} [Mon Feb 21 00:44:01 2022] POST /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:44:02.392291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e65a07f3-ef2d-4975-94a8-ccbb9fd5b1a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:02.398658 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e65a07f3-ef2d-4975-94a8-ccbb9fd5b1a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:02.423600 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e65a07f3-ef2d-4975-94a8-ccbb9fd5b1a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:02.426355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e65a07f3-ef2d-4975-94a8-ccbb9fd5b1a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:02.428530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e65a07f3-ef2d-4975-94a8-ccbb9fd5b1a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:02.430808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e65a07f3-ef2d-4975-94a8-ccbb9fd5b1a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:02.470006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e65a07f3-ef2d-4975-94a8-ccbb9fd5b1a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081391 Feb 21 00:44:02.474597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 344/714] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:02.482484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5ed5c728-48f4-4994-a034-7b71c5dcca4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:02.488805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-5ff6cfb1-86ba-42ab-ae25-0e55c1e7f6be req-1d8b2306-e796-4fed-9b88-d61e537bd25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e018349-6a79-41ca-89e4-86d1bf355cd0", "tag": "01160744-2091-4d9b-9585-581bf4da5aa7"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:44:02.490949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:44:02.490949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:44:02.494469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5ed5c728-48f4-4994-a034-7b71c5dcca4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:02.500566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-5ff6cfb1-86ba-42ab-ae25-0e55c1e7f6be req-1d8b2306-e796-4fed-9b88-d61e537bd25c service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:02.503668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-5ff6cfb1-86ba-42ab-ae25-0e55c1e7f6be req-1d8b2306-e796-4fed-9b88-d61e537bd25c service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:02.505471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ed5c728-48f4-4994-a034-7b71c5dcca4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:02.509872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ed5c728-48f4-4994-a034-7b71c5dcca4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:02.511305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ed5c728-48f4-4994-a034-7b71c5dcca4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:02.511884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ed5c728-48f4-4994-a034-7b71c5dcca4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:02.531472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-5ff6cfb1-86ba-42ab-ae25-0e55c1e7f6be req-1d8b2306-e796-4fed-9b88-d61e537bd25c service nova] Creating event network-changed:01160744-2091-4d9b-9585-581bf4da5aa7 for instance 1e018349-6a79-41ca-89e4-86d1bf355cd0 on hv-cinder-81322 Feb 21 00:44:02.543519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-5ff6cfb1-86ba-42ab-ae25-0e55c1e7f6be req-1d8b2306-e796-4fed-9b88-d61e537bd25c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171123 Feb 21 00:44:02.544729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 371/715] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:44:02.550484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cf011c7a-d3e1-4e95-ac96-87b4c1a987c9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:02.551396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cf011c7a-d3e1-4e95-ac96-87b4c1a987c9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:02.558041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf011c7a-d3e1-4e95-ac96-87b4c1a987c9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:02.558752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf011c7a-d3e1-4e95-ac96-87b4c1a987c9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:02.559873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf011c7a-d3e1-4e95-ac96-87b4c1a987c9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:02.560782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf011c7a-d3e1-4e95-ac96-87b4c1a987c9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:02.682171 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cf011c7a-d3e1-4e95-ac96-87b4c1a987c9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:02.692158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cf011c7a-d3e1-4e95-ac96-87b4c1a987c9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.146077 Feb 21 00:44:02.693022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 372/716] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:02 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:02.704366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5ed5c728-48f4-4994-a034-7b71c5dcca4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:02.712864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5ed5c728-48f4-4994-a034-7b71c5dcca4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.236935 Feb 21 00:44:02.713734 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 345/717] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:03.482342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-638b282f-113c-464e-a5cb-c85b425e372a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:03.483242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-638b282f-113c-464e-a5cb-c85b425e372a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:03.490033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-638b282f-113c-464e-a5cb-c85b425e372a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:03.490613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-638b282f-113c-464e-a5cb-c85b425e372a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:03.491238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-638b282f-113c-464e-a5cb-c85b425e372a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:03.491663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-638b282f-113c-464e-a5cb-c85b425e372a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:03.522209 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-638b282f-113c-464e-a5cb-c85b425e372a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043692 Feb 21 00:44:03.523008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 373/718] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:03.588751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-900c2eab-8368-4287-9a3b-074f060f911b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:03.589323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-900c2eab-8368-4287-9a3b-074f060f911b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:03.596380 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-900c2eab-8368-4287-9a3b-074f060f911b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:03.596875 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-900c2eab-8368-4287-9a3b-074f060f911b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:03.597659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-900c2eab-8368-4287-9a3b-074f060f911b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:03.598061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-900c2eab-8368-4287-9a3b-074f060f911b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:03.709554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bd825b4c-3c6e-4929-9ed1-67fd4a7afd05 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:03.710118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bd825b4c-3c6e-4929-9ed1-67fd4a7afd05 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:03.716105 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd825b4c-3c6e-4929-9ed1-67fd4a7afd05 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:03.716563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd825b4c-3c6e-4929-9ed1-67fd4a7afd05 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:03.717336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd825b4c-3c6e-4929-9ed1-67fd4a7afd05 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:03.717769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd825b4c-3c6e-4929-9ed1-67fd4a7afd05 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:03.788026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bd825b4c-3c6e-4929-9ed1-67fd4a7afd05 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:03.797088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bd825b4c-3c6e-4929-9ed1-67fd4a7afd05 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.091305 Feb 21 00:44:03.798015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 374/719] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:03 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:03.802067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b10f87a8-6a54-4804-bbf6-3e34aa1da609 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:03.802930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b10f87a8-6a54-4804-bbf6-3e34aa1da609 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:03.808413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b10f87a8-6a54-4804-bbf6-3e34aa1da609 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:03.808861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b10f87a8-6a54-4804-bbf6-3e34aa1da609 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:03.809637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b10f87a8-6a54-4804-bbf6-3e34aa1da609 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:03.810067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b10f87a8-6a54-4804-bbf6-3e34aa1da609 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:03.940085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b10f87a8-6a54-4804-bbf6-3e34aa1da609 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:03.947874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b10f87a8-6a54-4804-bbf6-3e34aa1da609 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.149081 Feb 21 00:44:03.948580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 375/720] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:03 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:04.534539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c1a8d800-57aa-4965-b82e-8e8b67949334 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:04.535518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c1a8d800-57aa-4965-b82e-8e8b67949334 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:04.542646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c1a8d800-57aa-4965-b82e-8e8b67949334 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:04.543085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c1a8d800-57aa-4965-b82e-8e8b67949334 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:04.543864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c1a8d800-57aa-4965-b82e-8e8b67949334 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:04.544289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c1a8d800-57aa-4965-b82e-8e8b67949334 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:04.575432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c1a8d800-57aa-4965-b82e-8e8b67949334 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044800 Feb 21 00:44:04.576036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 376/721] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:04.580381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-12453d94-5a47-4b31-95c6-f1f3c73144a7 req-8bb0fe0e-738b-4de4-9cf4-e7c6e6e7221e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e018349-6a79-41ca-89e4-86d1bf355cd0", "tag": "01160744-2091-4d9b-9585-581bf4da5aa7"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:44:04.581931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:44:04.581931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:44:04.588955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-12453d94-5a47-4b31-95c6-f1f3c73144a7 req-8bb0fe0e-738b-4de4-9cf4-e7c6e6e7221e service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:04.589392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-12453d94-5a47-4b31-95c6-f1f3c73144a7 req-8bb0fe0e-738b-4de4-9cf4-e7c6e6e7221e service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:04.600568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-12453d94-5a47-4b31-95c6-f1f3c73144a7 req-8bb0fe0e-738b-4de4-9cf4-e7c6e6e7221e service nova] Creating event network-changed:01160744-2091-4d9b-9585-581bf4da5aa7 for instance 1e018349-6a79-41ca-89e4-86d1bf355cd0 on hv-cinder-81322 Feb 21 00:44:04.605479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-12453d94-5a47-4b31-95c6-f1f3c73144a7 req-8bb0fe0e-738b-4de4-9cf4-e7c6e6e7221e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028279 Feb 21 00:44:04.606246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 377/722] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:44:04.814046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e72c5c08-037a-4b4f-945e-b61226ac5499 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:04.814768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e72c5c08-037a-4b4f-945e-b61226ac5499 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:04.821341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e72c5c08-037a-4b4f-945e-b61226ac5499 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:04.822262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e72c5c08-037a-4b4f-945e-b61226ac5499 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:04.823041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e72c5c08-037a-4b4f-945e-b61226ac5499 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:04.823518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e72c5c08-037a-4b4f-945e-b61226ac5499 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:04.905547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e72c5c08-037a-4b4f-945e-b61226ac5499 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:04.913531 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e72c5c08-037a-4b4f-945e-b61226ac5499 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.103596 Feb 21 00:44:04.920181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 378/723] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:04 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:04.965006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8fee3734-0d69-45fc-ba2a-edcef2b71bf6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:04.965618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8fee3734-0d69-45fc-ba2a-edcef2b71bf6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:04.971688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8fee3734-0d69-45fc-ba2a-edcef2b71bf6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:04.972135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8fee3734-0d69-45fc-ba2a-edcef2b71bf6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:04.972915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8fee3734-0d69-45fc-ba2a-edcef2b71bf6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:04.973347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8fee3734-0d69-45fc-ba2a-edcef2b71bf6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:05.189801 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8fee3734-0d69-45fc-ba2a-edcef2b71bf6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:05.199045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8fee3734-0d69-45fc-ba2a-edcef2b71bf6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.237729 Feb 21 00:44:05.199659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 379/724] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:04 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:05.590250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d7a06b85-91ca-464d-8d0a-255ca8dba2f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:05.591156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d7a06b85-91ca-464d-8d0a-255ca8dba2f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:05.597751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7a06b85-91ca-464d-8d0a-255ca8dba2f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:05.598204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7a06b85-91ca-464d-8d0a-255ca8dba2f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:05.598968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7a06b85-91ca-464d-8d0a-255ca8dba2f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:05.599387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7a06b85-91ca-464d-8d0a-255ca8dba2f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:05.628603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d7a06b85-91ca-464d-8d0a-255ca8dba2f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044176 Feb 21 00:44:05.629145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 380/725] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:05.933959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-224f3dd5-fd43-4dc5-9b55-dcd8a7dc88e3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:05.934630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-224f3dd5-fd43-4dc5-9b55-dcd8a7dc88e3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:05.942693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-224f3dd5-fd43-4dc5-9b55-dcd8a7dc88e3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:05.943295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-224f3dd5-fd43-4dc5-9b55-dcd8a7dc88e3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:05.944301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-224f3dd5-fd43-4dc5-9b55-dcd8a7dc88e3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:05.944904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-224f3dd5-fd43-4dc5-9b55-dcd8a7dc88e3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:06.016078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-224f3dd5-fd43-4dc5-9b55-dcd8a7dc88e3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:06.027398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-224f3dd5-fd43-4dc5-9b55-dcd8a7dc88e3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.099296 Feb 21 00:44:06.028138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 381/726] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:05 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:06.220086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-905ff2dc-204a-491c-8483-e6cc5a5c527a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:06.221007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-905ff2dc-204a-491c-8483-e6cc5a5c527a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:06.230594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-905ff2dc-204a-491c-8483-e6cc5a5c527a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:06.231031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-905ff2dc-204a-491c-8483-e6cc5a5c527a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:06.231777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-905ff2dc-204a-491c-8483-e6cc5a5c527a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:06.232228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-905ff2dc-204a-491c-8483-e6cc5a5c527a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:06.382106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-905ff2dc-204a-491c-8483-e6cc5a5c527a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:06.389902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-905ff2dc-204a-491c-8483-e6cc5a5c527a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.176040 Feb 21 00:44:06.390465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 382/727] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:06 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:06.643418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f36d0988-a714-4d80-8f98-4235e52bcb22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:06.644907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f36d0988-a714-4d80-8f98-4235e52bcb22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:06.654087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f36d0988-a714-4d80-8f98-4235e52bcb22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:06.654825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f36d0988-a714-4d80-8f98-4235e52bcb22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:06.655598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f36d0988-a714-4d80-8f98-4235e52bcb22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:06.656019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f36d0988-a714-4d80-8f98-4235e52bcb22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:06.684569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f36d0988-a714-4d80-8f98-4235e52bcb22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047391 Feb 21 00:44:06.685101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 383/728] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:06 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:07.052462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-554cd544-2fe7-4704-a3af-a7b3f6eda9f0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:07.053676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-554cd544-2fe7-4704-a3af-a7b3f6eda9f0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:07.063092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-554cd544-2fe7-4704-a3af-a7b3f6eda9f0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:07.063758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-554cd544-2fe7-4704-a3af-a7b3f6eda9f0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:07.064982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-554cd544-2fe7-4704-a3af-a7b3f6eda9f0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:07.065639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-554cd544-2fe7-4704-a3af-a7b3f6eda9f0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:07.135513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-554cd544-2fe7-4704-a3af-a7b3f6eda9f0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:07.143187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-554cd544-2fe7-4704-a3af-a7b3f6eda9f0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.096391 Feb 21 00:44:07.143740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 384/729] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:07 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:07.410828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b8b6647e-5bea-4687-b2c0-a7c6be834992 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:07.412053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b8b6647e-5bea-4687-b2c0-a7c6be834992 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:07.422493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8b6647e-5bea-4687-b2c0-a7c6be834992 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:07.423307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8b6647e-5bea-4687-b2c0-a7c6be834992 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:07.424671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8b6647e-5bea-4687-b2c0-a7c6be834992 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:07.425378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8b6647e-5bea-4687-b2c0-a7c6be834992 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:07.565869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b8b6647e-5bea-4687-b2c0-a7c6be834992 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:07.573842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b8b6647e-5bea-4687-b2c0-a7c6be834992 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.169917 Feb 21 00:44:07.574399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 385/730] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:07 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:07.699683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a384d42e-39eb-41b5-a67d-df7bdec53c16 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:07.701059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a384d42e-39eb-41b5-a67d-df7bdec53c16 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:07.711238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a384d42e-39eb-41b5-a67d-df7bdec53c16 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:07.711982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a384d42e-39eb-41b5-a67d-df7bdec53c16 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:07.713305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a384d42e-39eb-41b5-a67d-df7bdec53c16 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:07.713976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a384d42e-39eb-41b5-a67d-df7bdec53c16 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:07.751181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a384d42e-39eb-41b5-a67d-df7bdec53c16 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057657 Feb 21 00:44:07.751806 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 386/731] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:07 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:08.164381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7eb0743f-1cd3-410d-af12-29ac06b29671 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:08.165436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7eb0743f-1cd3-410d-af12-29ac06b29671 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:08.175507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb0743f-1cd3-410d-af12-29ac06b29671 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:08.176242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb0743f-1cd3-410d-af12-29ac06b29671 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:08.177675 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb0743f-1cd3-410d-af12-29ac06b29671 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:08.178402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb0743f-1cd3-410d-af12-29ac06b29671 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:08.241625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7eb0743f-1cd3-410d-af12-29ac06b29671 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:08.253188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7eb0743f-1cd3-410d-af12-29ac06b29671 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.094815 Feb 21 00:44:08.253909 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 387/732] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:08 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:08.699378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b7469826-2338-4c58-a942-fc4160c9f4d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:08.699864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b7469826-2338-4c58-a942-fc4160c9f4d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:08.706472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7469826-2338-4c58-a942-fc4160c9f4d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:08.707059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7469826-2338-4c58-a942-fc4160c9f4d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:08.707871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7469826-2338-4c58-a942-fc4160c9f4d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:08.708285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7469826-2338-4c58-a942-fc4160c9f4d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:08.844706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b7469826-2338-4c58-a942-fc4160c9f4d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:08.854590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b7469826-2338-4c58-a942-fc4160c9f4d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.266750 Feb 21 00:44:08.864492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 388/733] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:08 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:08.864492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5f6a0a63-413b-4702-a6a6-900a78070096 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:08.864492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5f6a0a63-413b-4702-a6a6-900a78070096 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:08.867405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f6a0a63-413b-4702-a6a6-900a78070096 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:08.867855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f6a0a63-413b-4702-a6a6-900a78070096 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:08.868658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f6a0a63-413b-4702-a6a6-900a78070096 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:08.869093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f6a0a63-413b-4702-a6a6-900a78070096 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:08.898217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5f6a0a63-413b-4702-a6a6-900a78070096 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041426 Feb 21 00:44:08.898768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 389/734] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:09.276166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b5d3f407-9d14-45fc-9db1-9f8c97033f91 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:09.277233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b5d3f407-9d14-45fc-9db1-9f8c97033f91 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:09.287647 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5d3f407-9d14-45fc-9db1-9f8c97033f91 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:09.288423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5d3f407-9d14-45fc-9db1-9f8c97033f91 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:09.289708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5d3f407-9d14-45fc-9db1-9f8c97033f91 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:09.290424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5d3f407-9d14-45fc-9db1-9f8c97033f91 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:09.353311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b5d3f407-9d14-45fc-9db1-9f8c97033f91 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:09.362850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b5d3f407-9d14-45fc-9db1-9f8c97033f91 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.092702 Feb 21 00:44:09.363443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 390/735] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:09 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:09.875934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-608b202e-f955-42a3-8eff-264e67d4cd71 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:09.877006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-608b202e-f955-42a3-8eff-264e67d4cd71 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:09.886678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-608b202e-f955-42a3-8eff-264e67d4cd71 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:09.887123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-608b202e-f955-42a3-8eff-264e67d4cd71 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:09.887895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-608b202e-f955-42a3-8eff-264e67d4cd71 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:09.888324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-608b202e-f955-42a3-8eff-264e67d4cd71 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:10.024542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-608b202e-f955-42a3-8eff-264e67d4cd71 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:10.032991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-608b202e-f955-42a3-8eff-264e67d4cd71 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.163282 Feb 21 00:44:10.033552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 391/736] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:09 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:10.037870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b1d4a666-1d61-44a5-a50c-72f486c3808d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:10.038776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b1d4a666-1d61-44a5-a50c-72f486c3808d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:10.044678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b1d4a666-1d61-44a5-a50c-72f486c3808d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:10.045111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b1d4a666-1d61-44a5-a50c-72f486c3808d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:10.045870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b1d4a666-1d61-44a5-a50c-72f486c3808d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:10.046289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b1d4a666-1d61-44a5-a50c-72f486c3808d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:10.074573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b1d4a666-1d61-44a5-a50c-72f486c3808d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040059 Feb 21 00:44:10.075107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 392/737] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:10 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:10.386804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6a236a1c-7188-4676-8416-453133a27338 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:10.387984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6a236a1c-7188-4676-8416-453133a27338 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:10.398007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a236a1c-7188-4676-8416-453133a27338 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:10.398744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a236a1c-7188-4676-8416-453133a27338 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:10.400021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a236a1c-7188-4676-8416-453133a27338 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:10.400799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a236a1c-7188-4676-8416-453133a27338 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:10.461369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6a236a1c-7188-4676-8416-453133a27338 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:10.469976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6a236a1c-7188-4676-8416-453133a27338 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.089279 Feb 21 00:44:10.470538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 393/738] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:10 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:11.053818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce2bb27c-1ba8-41fa-8168-16ddfe5db448 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:11.054907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce2bb27c-1ba8-41fa-8168-16ddfe5db448 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:11.062464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce2bb27c-1ba8-41fa-8168-16ddfe5db448 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:11.062902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce2bb27c-1ba8-41fa-8168-16ddfe5db448 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:11.063665 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce2bb27c-1ba8-41fa-8168-16ddfe5db448 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:11.064086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce2bb27c-1ba8-41fa-8168-16ddfe5db448 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:11.219640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce2bb27c-1ba8-41fa-8168-16ddfe5db448 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:11.230614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce2bb27c-1ba8-41fa-8168-16ddfe5db448 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.182872 Feb 21 00:44:11.231153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 394/739] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:11 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:11.235519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-38502586-09dc-462d-acc5-c4adfb62122d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:11.236409 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-38502586-09dc-462d-acc5-c4adfb62122d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:11.242266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38502586-09dc-462d-acc5-c4adfb62122d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:11.242702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38502586-09dc-462d-acc5-c4adfb62122d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:11.243464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38502586-09dc-462d-acc5-c4adfb62122d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:11.243886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38502586-09dc-462d-acc5-c4adfb62122d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:11.272436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-38502586-09dc-462d-acc5-c4adfb62122d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040290 Feb 21 00:44:11.272981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 395/740] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:11.486943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-589966a9-b0e0-41a3-8566-95f293713174 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:11.487461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-589966a9-b0e0-41a3-8566-95f293713174 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:11.496240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-589966a9-b0e0-41a3-8566-95f293713174 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:11.497002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-589966a9-b0e0-41a3-8566-95f293713174 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:11.498269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-589966a9-b0e0-41a3-8566-95f293713174 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:11.498964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-589966a9-b0e0-41a3-8566-95f293713174 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:11.568196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-589966a9-b0e0-41a3-8566-95f293713174 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:11.576077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-589966a9-b0e0-41a3-8566-95f293713174 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.092915 Feb 21 00:44:11.576687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 396/741] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:11 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:12.251267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-71ca6e7f-a586-4b4b-af6c-e1b222d7461b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:12.252285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-71ca6e7f-a586-4b4b-af6c-e1b222d7461b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:12.262162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-71ca6e7f-a586-4b4b-af6c-e1b222d7461b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:12.262601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-71ca6e7f-a586-4b4b-af6c-e1b222d7461b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:12.263358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-71ca6e7f-a586-4b4b-af6c-e1b222d7461b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:12.263778 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-71ca6e7f-a586-4b4b-af6c-e1b222d7461b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:12.394328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-71ca6e7f-a586-4b4b-af6c-e1b222d7461b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:12.401919 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-71ca6e7f-a586-4b4b-af6c-e1b222d7461b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.156834 Feb 21 00:44:12.402524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 397/742] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:12 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:12.407086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-131412fc-837c-4d4f-a96d-f27894a3e162 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:12.407966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-131412fc-837c-4d4f-a96d-f27894a3e162 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:12.414905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-131412fc-837c-4d4f-a96d-f27894a3e162 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:12.415603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-131412fc-837c-4d4f-a96d-f27894a3e162 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:12.416884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-131412fc-837c-4d4f-a96d-f27894a3e162 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:12.417568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-131412fc-837c-4d4f-a96d-f27894a3e162 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:12.451267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-131412fc-837c-4d4f-a96d-f27894a3e162 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047799 Feb 21 00:44:12.451809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 398/743] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:12.594187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eb245c3f-d67d-47d2-b6e9-5ecfa3ae5606 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:12.594831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eb245c3f-d67d-47d2-b6e9-5ecfa3ae5606 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:12.603282 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb245c3f-d67d-47d2-b6e9-5ecfa3ae5606 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:12.604021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb245c3f-d67d-47d2-b6e9-5ecfa3ae5606 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:12.605217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb245c3f-d67d-47d2-b6e9-5ecfa3ae5606 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:12.605760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb245c3f-d67d-47d2-b6e9-5ecfa3ae5606 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:12.670840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eb245c3f-d67d-47d2-b6e9-5ecfa3ae5606 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:12.678363 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eb245c3f-d67d-47d2-b6e9-5ecfa3ae5606 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.088900 Feb 21 00:44:12.678922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 399/744] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:12 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:13.425725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b5d7d2a7-fb9a-44ce-a48a-35107b0db9fb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:13.426829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b5d7d2a7-fb9a-44ce-a48a-35107b0db9fb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:13.436670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5d7d2a7-fb9a-44ce-a48a-35107b0db9fb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:13.437111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5d7d2a7-fb9a-44ce-a48a-35107b0db9fb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:13.437902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5d7d2a7-fb9a-44ce-a48a-35107b0db9fb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:13.438321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5d7d2a7-fb9a-44ce-a48a-35107b0db9fb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:13.579426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b5d7d2a7-fb9a-44ce-a48a-35107b0db9fb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:13.589152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b5d7d2a7-fb9a-44ce-a48a-35107b0db9fb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.171744 Feb 21 00:44:13.589989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 400/745] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:13.596465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fb8e4dfb-aa51-4ee2-9f66-b1b08ed221ea tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:13.597815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fb8e4dfb-aa51-4ee2-9f66-b1b08ed221ea tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:13.606158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb8e4dfb-aa51-4ee2-9f66-b1b08ed221ea tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:13.606647 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb8e4dfb-aa51-4ee2-9f66-b1b08ed221ea tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:13.607431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb8e4dfb-aa51-4ee2-9f66-b1b08ed221ea tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:13.607850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb8e4dfb-aa51-4ee2-9f66-b1b08ed221ea tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:13.639277 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fb8e4dfb-aa51-4ee2-9f66-b1b08ed221ea tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047920 Feb 21 00:44:13.639833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 401/746] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:13.694761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-090bf9e0-80f0-4d8f-a2d9-6b52e9bebbc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:13.695398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-090bf9e0-80f0-4d8f-a2d9-6b52e9bebbc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:13.701621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-090bf9e0-80f0-4d8f-a2d9-6b52e9bebbc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:13.702059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-090bf9e0-80f0-4d8f-a2d9-6b52e9bebbc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:13.702814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-090bf9e0-80f0-4d8f-a2d9-6b52e9bebbc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:13.703261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-090bf9e0-80f0-4d8f-a2d9-6b52e9bebbc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:13.771519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-090bf9e0-80f0-4d8f-a2d9-6b52e9bebbc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:13.779820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-090bf9e0-80f0-4d8f-a2d9-6b52e9bebbc8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.088313 Feb 21 00:44:13.780426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 402/747] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:13 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:14.614272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4f273600-e2cc-4360-b818-bab2021d3da9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:14.615755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4f273600-e2cc-4360-b818-bab2021d3da9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:14.624204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4f273600-e2cc-4360-b818-bab2021d3da9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:14.624664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4f273600-e2cc-4360-b818-bab2021d3da9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:14.625431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4f273600-e2cc-4360-b818-bab2021d3da9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:14.625853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4f273600-e2cc-4360-b818-bab2021d3da9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:14.769834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4f273600-e2cc-4360-b818-bab2021d3da9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:14.777902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4f273600-e2cc-4360-b818-bab2021d3da9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.169789 Feb 21 00:44:14.778469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 403/748] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:14.783176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4b5d2d50-892f-4671-bea1-ad384a921519 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:14.783972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4b5d2d50-892f-4671-bea1-ad384a921519 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:14.789815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b5d2d50-892f-4671-bea1-ad384a921519 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:14.790280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b5d2d50-892f-4671-bea1-ad384a921519 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:14.791036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b5d2d50-892f-4671-bea1-ad384a921519 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:14.791431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b5d2d50-892f-4671-bea1-ad384a921519 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:14.821252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4b5d2d50-892f-4671-bea1-ad384a921519 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041849 Feb 21 00:44:14.821789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 404/749] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:14.827882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d0bbf3bb-36a1-4aa4-860f-5a785ca5a95a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:14.828505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d0bbf3bb-36a1-4aa4-860f-5a785ca5a95a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:14.834211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d0bbf3bb-36a1-4aa4-860f-5a785ca5a95a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:14.834648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d0bbf3bb-36a1-4aa4-860f-5a785ca5a95a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:14.835403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d0bbf3bb-36a1-4aa4-860f-5a785ca5a95a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:14.835825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d0bbf3bb-36a1-4aa4-860f-5a785ca5a95a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:14.895764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d0bbf3bb-36a1-4aa4-860f-5a785ca5a95a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:14.904022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d0bbf3bb-36a1-4aa4-860f-5a785ca5a95a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.081339 Feb 21 00:44:14.904930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 405/750] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:14 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:15.799072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f9501d89-9f53-4b12-b7e9-b667226f598b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:15.800073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f9501d89-9f53-4b12-b7e9-b667226f598b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:15.810619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f9501d89-9f53-4b12-b7e9-b667226f598b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:15.811357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f9501d89-9f53-4b12-b7e9-b667226f598b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:15.812664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f9501d89-9f53-4b12-b7e9-b667226f598b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:15.813369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f9501d89-9f53-4b12-b7e9-b667226f598b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:15.954279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f9501d89-9f53-4b12-b7e9-b667226f598b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:15.962165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f9501d89-9f53-4b12-b7e9-b667226f598b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.169423 Feb 21 00:44:15.962730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 406/751] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:15.967070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b7f81030-b73b-4adc-a6f3-b4ab508340d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:15.967953 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b7f81030-b73b-4adc-a6f3-b4ab508340d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:15.973697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7f81030-b73b-4adc-a6f3-b4ab508340d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:15.974156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7f81030-b73b-4adc-a6f3-b4ab508340d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:15.974891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7f81030-b73b-4adc-a6f3-b4ab508340d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:15.975311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7f81030-b73b-4adc-a6f3-b4ab508340d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:16.004624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b7f81030-b73b-4adc-a6f3-b4ab508340d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040881 Feb 21 00:44:16.005166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 407/752] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:16.009136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3296240e-2ad4-4537-986a-761ecf4e42ca tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:16.009726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3296240e-2ad4-4537-986a-761ecf4e42ca tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:16.015641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3296240e-2ad4-4537-986a-761ecf4e42ca tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:16.016077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3296240e-2ad4-4537-986a-761ecf4e42ca tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:16.016863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3296240e-2ad4-4537-986a-761ecf4e42ca tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:16.017290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3296240e-2ad4-4537-986a-761ecf4e42ca tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:16.076691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3296240e-2ad4-4537-986a-761ecf4e42ca tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:16.084605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3296240e-2ad4-4537-986a-761ecf4e42ca tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.078438 Feb 21 00:44:16.085158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 408/753] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:16 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:16.983125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1ad133d5-75ac-4f85-a040-a4c47e6b2a84 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:16.984183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1ad133d5-75ac-4f85-a040-a4c47e6b2a84 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:16.994596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1ad133d5-75ac-4f85-a040-a4c47e6b2a84 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:16.995188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1ad133d5-75ac-4f85-a040-a4c47e6b2a84 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:16.995952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1ad133d5-75ac-4f85-a040-a4c47e6b2a84 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:16.996369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1ad133d5-75ac-4f85-a040-a4c47e6b2a84 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:17.130846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1ad133d5-75ac-4f85-a040-a4c47e6b2a84 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:17.138198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1ad133d5-75ac-4f85-a040-a4c47e6b2a84 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161570 Feb 21 00:44:17.138738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 409/754] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:17.143431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fc628ddc-c335-4abf-9310-204b566d0d5a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:17.144320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fc628ddc-c335-4abf-9310-204b566d0d5a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:17.150016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc628ddc-c335-4abf-9310-204b566d0d5a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:17.150454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc628ddc-c335-4abf-9310-204b566d0d5a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:17.151273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc628ddc-c335-4abf-9310-204b566d0d5a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:17.151691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc628ddc-c335-4abf-9310-204b566d0d5a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:17.180735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fc628ddc-c335-4abf-9310-204b566d0d5a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040942 Feb 21 00:44:17.181276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 410/755] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:17 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:17.185350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d144e793-168c-4df9-8234-9679323fc326 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:17.185931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d144e793-168c-4df9-8234-9679323fc326 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:17.191299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d144e793-168c-4df9-8234-9679323fc326 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:17.191738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d144e793-168c-4df9-8234-9679323fc326 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:17.192517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d144e793-168c-4df9-8234-9679323fc326 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:17.192947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d144e793-168c-4df9-8234-9679323fc326 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:17.253557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d144e793-168c-4df9-8234-9679323fc326 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:17.261102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d144e793-168c-4df9-8234-9679323fc326 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.078951 Feb 21 00:44:17.261716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 411/756] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:17 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:18.159968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-54860d62-f7a6-45c8-bd55-e4956a1dfccc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:18.161199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-54860d62-f7a6-45c8-bd55-e4956a1dfccc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:18.169895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54860d62-f7a6-45c8-bd55-e4956a1dfccc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:18.170344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54860d62-f7a6-45c8-bd55-e4956a1dfccc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:18.171118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54860d62-f7a6-45c8-bd55-e4956a1dfccc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:18.171544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54860d62-f7a6-45c8-bd55-e4956a1dfccc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:18.315222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-54860d62-f7a6-45c8-bd55-e4956a1dfccc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:18.323256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-54860d62-f7a6-45c8-bd55-e4956a1dfccc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.169622 Feb 21 00:44:18.323826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 412/757] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:18 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:18.328491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-651a3242-50cd-49dc-8318-adeb793faae0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:18.329383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-651a3242-50cd-49dc-8318-adeb793faae0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:18.336266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-651a3242-50cd-49dc-8318-adeb793faae0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:18.337021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-651a3242-50cd-49dc-8318-adeb793faae0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:18.338331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-651a3242-50cd-49dc-8318-adeb793faae0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:18.338907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-651a3242-50cd-49dc-8318-adeb793faae0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:18.367722 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-651a3242-50cd-49dc-8318-adeb793faae0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042932 Feb 21 00:44:18.368259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 413/758] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:18.373022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b37056ac-630a-40db-acb5-1cb0e3c83579 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:18.373612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b37056ac-630a-40db-acb5-1cb0e3c83579 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:18.379769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b37056ac-630a-40db-acb5-1cb0e3c83579 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:18.380207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b37056ac-630a-40db-acb5-1cb0e3c83579 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:18.381005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b37056ac-630a-40db-acb5-1cb0e3c83579 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:18.381428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b37056ac-630a-40db-acb5-1cb0e3c83579 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:18.446580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b37056ac-630a-40db-acb5-1cb0e3c83579 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:18.454252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b37056ac-630a-40db-acb5-1cb0e3c83579 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.084385 Feb 21 00:44:18.454799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 414/759] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:18 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:19.344580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f2b9d3b2-e645-49dc-98d3-1b2f2166aabe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:19.345611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f2b9d3b2-e645-49dc-98d3-1b2f2166aabe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:19.356249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2b9d3b2-e645-49dc-98d3-1b2f2166aabe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:19.357060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2b9d3b2-e645-49dc-98d3-1b2f2166aabe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:19.358328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2b9d3b2-e645-49dc-98d3-1b2f2166aabe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:19.359046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2b9d3b2-e645-49dc-98d3-1b2f2166aabe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:19.496263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f2b9d3b2-e645-49dc-98d3-1b2f2166aabe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:19.504440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f2b9d3b2-e645-49dc-98d3-1b2f2166aabe tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.166175 Feb 21 00:44:19.505032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 415/760] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:19 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:19.509395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-80506752-6d03-44d7-834f-f7ed73f6f77b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:19.510333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-80506752-6d03-44d7-834f-f7ed73f6f77b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:19.516199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80506752-6d03-44d7-834f-f7ed73f6f77b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:19.516671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80506752-6d03-44d7-834f-f7ed73f6f77b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:19.517443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80506752-6d03-44d7-834f-f7ed73f6f77b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:19.517870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80506752-6d03-44d7-834f-f7ed73f6f77b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:19.551818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-80506752-6d03-44d7-834f-f7ed73f6f77b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045749 Feb 21 00:44:19.552380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 416/761] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:19.556567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d7918c87-1b29-4b54-97b0-9ece98b5d69c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:19.557151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d7918c87-1b29-4b54-97b0-9ece98b5d69c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:19.562967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7918c87-1b29-4b54-97b0-9ece98b5d69c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:19.563405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7918c87-1b29-4b54-97b0-9ece98b5d69c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:19.564166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7918c87-1b29-4b54-97b0-9ece98b5d69c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:19.564619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7918c87-1b29-4b54-97b0-9ece98b5d69c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:19.628920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d7918c87-1b29-4b54-97b0-9ece98b5d69c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:19.636740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d7918c87-1b29-4b54-97b0-9ece98b5d69c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.083377 Feb 21 00:44:19.637303 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 417/762] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:19 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:20.524482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-68a7030a-9042-45ac-8803-6f6d46ea2ec8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:20.525529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-68a7030a-9042-45ac-8803-6f6d46ea2ec8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:20.536276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68a7030a-9042-45ac-8803-6f6d46ea2ec8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:20.537054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68a7030a-9042-45ac-8803-6f6d46ea2ec8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:20.538331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68a7030a-9042-45ac-8803-6f6d46ea2ec8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:20.539055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68a7030a-9042-45ac-8803-6f6d46ea2ec8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:20.680635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-68a7030a-9042-45ac-8803-6f6d46ea2ec8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:20.688832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-68a7030a-9042-45ac-8803-6f6d46ea2ec8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.170507 Feb 21 00:44:20.689399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 418/763] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:20 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:20.693719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-523a52cd-f211-43c5-9c1c-a93181c24f74 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:20.694616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-523a52cd-f211-43c5-9c1c-a93181c24f74 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:20.700004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-523a52cd-f211-43c5-9c1c-a93181c24f74 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:20.700478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-523a52cd-f211-43c5-9c1c-a93181c24f74 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:20.701243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-523a52cd-f211-43c5-9c1c-a93181c24f74 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:20.701670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-523a52cd-f211-43c5-9c1c-a93181c24f74 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:20.731635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-523a52cd-f211-43c5-9c1c-a93181c24f74 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041242 Feb 21 00:44:20.732191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 419/764] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:20.736316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e2830a85-d80f-474f-bbca-d35c8c4a8ebf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:20.736937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e2830a85-d80f-474f-bbca-d35c8c4a8ebf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:20.743241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2830a85-d80f-474f-bbca-d35c8c4a8ebf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:20.743684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2830a85-d80f-474f-bbca-d35c8c4a8ebf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:20.744574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2830a85-d80f-474f-bbca-d35c8c4a8ebf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:20.745005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2830a85-d80f-474f-bbca-d35c8c4a8ebf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:20.804606 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e2830a85-d80f-474f-bbca-d35c8c4a8ebf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:20.812205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e2830a85-d80f-474f-bbca-d35c8c4a8ebf tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.079065 Feb 21 00:44:20.812802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 420/765] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:20 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:21.709770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b8472f92-7aac-498a-a253-00f96918a7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:21.710775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b8472f92-7aac-498a-a253-00f96918a7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:21.718891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8472f92-7aac-498a-a253-00f96918a7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:21.719408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8472f92-7aac-498a-a253-00f96918a7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:21.720253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8472f92-7aac-498a-a253-00f96918a7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:21.720757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8472f92-7aac-498a-a253-00f96918a7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:21.857792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b8472f92-7aac-498a-a253-00f96918a7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:21.865424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b8472f92-7aac-498a-a253-00f96918a7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161785 Feb 21 00:44:21.865957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 421/766] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:21 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:21.870222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e7b0e28c-a610-4b04-ad5b-e992b06a082d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:21.871105 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e7b0e28c-a610-4b04-ad5b-e992b06a082d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:21.876539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7b0e28c-a610-4b04-ad5b-e992b06a082d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:21.876979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7b0e28c-a610-4b04-ad5b-e992b06a082d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:21.877734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7b0e28c-a610-4b04-ad5b-e992b06a082d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:21.878156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7b0e28c-a610-4b04-ad5b-e992b06a082d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:21.907239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e7b0e28c-a610-4b04-ad5b-e992b06a082d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040313 Feb 21 00:44:21.907827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 422/767] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:21.911791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6d155ea8-168c-48ab-9d2a-a23696eddfd1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:21.912376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6d155ea8-168c-48ab-9d2a-a23696eddfd1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:21.917791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d155ea8-168c-48ab-9d2a-a23696eddfd1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:21.918220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d155ea8-168c-48ab-9d2a-a23696eddfd1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:21.918969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d155ea8-168c-48ab-9d2a-a23696eddfd1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:21.919390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d155ea8-168c-48ab-9d2a-a23696eddfd1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:21.986107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6d155ea8-168c-48ab-9d2a-a23696eddfd1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:21.997464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6d155ea8-168c-48ab-9d2a-a23696eddfd1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.088467 Feb 21 00:44:21.998378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 423/768] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:21 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:22.885881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1c946c98-58b6-415c-9f7d-2fa8fde2ea40 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:22.886911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1c946c98-58b6-415c-9f7d-2fa8fde2ea40 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:22.897151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c946c98-58b6-415c-9f7d-2fa8fde2ea40 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:22.897862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c946c98-58b6-415c-9f7d-2fa8fde2ea40 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:22.898879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c946c98-58b6-415c-9f7d-2fa8fde2ea40 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:22.899568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c946c98-58b6-415c-9f7d-2fa8fde2ea40 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:23.047133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1c946c98-58b6-415c-9f7d-2fa8fde2ea40 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:23.054466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1c946c98-58b6-415c-9f7d-2fa8fde2ea40 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.174610 Feb 21 00:44:23.055022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 424/769] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:22 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:23.059500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eda2ba3b-cec3-4ee2-82d8-f4a98f92794d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:23.060444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eda2ba3b-cec3-4ee2-82d8-f4a98f92794d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:23.066358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eda2ba3b-cec3-4ee2-82d8-f4a98f92794d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:23.066796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eda2ba3b-cec3-4ee2-82d8-f4a98f92794d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:23.067556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eda2ba3b-cec3-4ee2-82d8-f4a98f92794d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:23.068044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eda2ba3b-cec3-4ee2-82d8-f4a98f92794d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:23.096205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eda2ba3b-cec3-4ee2-82d8-f4a98f92794d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040246 Feb 21 00:44:23.096783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 425/770] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:23.100799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cf9a7143-cd4c-4e83-9222-fd2bdef50e8a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:23.101386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cf9a7143-cd4c-4e83-9222-fd2bdef50e8a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:23.107180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf9a7143-cd4c-4e83-9222-fd2bdef50e8a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:23.107619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf9a7143-cd4c-4e83-9222-fd2bdef50e8a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:23.108378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf9a7143-cd4c-4e83-9222-fd2bdef50e8a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:23.108833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf9a7143-cd4c-4e83-9222-fd2bdef50e8a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:23.168116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cf9a7143-cd4c-4e83-9222-fd2bdef50e8a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:23.175863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cf9a7143-cd4c-4e83-9222-fd2bdef50e8a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.078135 Feb 21 00:44:23.176432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 426/771] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:23 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:24.074782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-454a1169-6187-4f51-8480-e060c0cc3f86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:24.075534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-454a1169-6187-4f51-8480-e060c0cc3f86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:24.082285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-454a1169-6187-4f51-8480-e060c0cc3f86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:24.082754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-454a1169-6187-4f51-8480-e060c0cc3f86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:24.083564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-454a1169-6187-4f51-8480-e060c0cc3f86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:24.084015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-454a1169-6187-4f51-8480-e060c0cc3f86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:24.224200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-454a1169-6187-4f51-8480-e060c0cc3f86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:24.231632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-454a1169-6187-4f51-8480-e060c0cc3f86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161968 Feb 21 00:44:24.232242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 427/772] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:24 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:24.236858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a924ba19-0abb-4e4d-b7f2-e7cdeedbcdbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:24.237770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a924ba19-0abb-4e4d-b7f2-e7cdeedbcdbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:24.244320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a924ba19-0abb-4e4d-b7f2-e7cdeedbcdbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:24.244814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a924ba19-0abb-4e4d-b7f2-e7cdeedbcdbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:24.245587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a924ba19-0abb-4e4d-b7f2-e7cdeedbcdbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:24.246012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a924ba19-0abb-4e4d-b7f2-e7cdeedbcdbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:24.279848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a924ba19-0abb-4e4d-b7f2-e7cdeedbcdbf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045996 Feb 21 00:44:24.280515 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 428/773] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:24.284906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-93b021df-7ec1-4370-aadb-8bab834b0d83 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:24.285506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-93b021df-7ec1-4370-aadb-8bab834b0d83 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:24.291779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93b021df-7ec1-4370-aadb-8bab834b0d83 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:24.292228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93b021df-7ec1-4370-aadb-8bab834b0d83 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:24.293031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93b021df-7ec1-4370-aadb-8bab834b0d83 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:24.293465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93b021df-7ec1-4370-aadb-8bab834b0d83 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:24.355628 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-93b021df-7ec1-4370-aadb-8bab834b0d83 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:24.366332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-93b021df-7ec1-4370-aadb-8bab834b0d83 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.084563 Feb 21 00:44:24.367034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 429/774] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:24 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:25.257669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9bee40c5-5309-421c-b22c-4c10b9a073f3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:25.258726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9bee40c5-5309-421c-b22c-4c10b9a073f3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:25.269346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bee40c5-5309-421c-b22c-4c10b9a073f3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:25.270081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bee40c5-5309-421c-b22c-4c10b9a073f3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:25.271402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bee40c5-5309-421c-b22c-4c10b9a073f3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:25.272114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bee40c5-5309-421c-b22c-4c10b9a073f3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:25.412599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9bee40c5-5309-421c-b22c-4c10b9a073f3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:25.420690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9bee40c5-5309-421c-b22c-4c10b9a073f3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.169116 Feb 21 00:44:25.421261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 430/775] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:25 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:25.425809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-16b835d1-c419-4835-b649-c90573517f78 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:25.426702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-16b835d1-c419-4835-b649-c90573517f78 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:25.432965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16b835d1-c419-4835-b649-c90573517f78 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:25.433388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16b835d1-c419-4835-b649-c90573517f78 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:25.434158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16b835d1-c419-4835-b649-c90573517f78 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:25.434579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-16b835d1-c419-4835-b649-c90573517f78 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:25.463340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-16b835d1-c419-4835-b649-c90573517f78 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041038 Feb 21 00:44:25.463881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 431/776] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:25.467884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1e48bf25-6e45-44d9-b9b5-5d02c1f9ecf0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:25.468495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1e48bf25-6e45-44d9-b9b5-5d02c1f9ecf0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:25.474291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1e48bf25-6e45-44d9-b9b5-5d02c1f9ecf0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:25.474733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1e48bf25-6e45-44d9-b9b5-5d02c1f9ecf0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:25.475493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1e48bf25-6e45-44d9-b9b5-5d02c1f9ecf0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:25.475923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1e48bf25-6e45-44d9-b9b5-5d02c1f9ecf0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:25.535825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1e48bf25-6e45-44d9-b9b5-5d02c1f9ecf0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:25.545189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1e48bf25-6e45-44d9-b9b5-5d02c1f9ecf0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080427 Feb 21 00:44:25.545762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 432/777] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:25 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:26.441907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dda0263a-898b-4ba0-8520-caebc4ebfd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:26.442857 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dda0263a-898b-4ba0-8520-caebc4ebfd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:26.451329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dda0263a-898b-4ba0-8520-caebc4ebfd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:26.451772 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dda0263a-898b-4ba0-8520-caebc4ebfd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:26.452581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dda0263a-898b-4ba0-8520-caebc4ebfd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:26.453012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dda0263a-898b-4ba0-8520-caebc4ebfd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:26.589382 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dda0263a-898b-4ba0-8520-caebc4ebfd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:26.596794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dda0263a-898b-4ba0-8520-caebc4ebfd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161323 Feb 21 00:44:26.597406 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 433/778] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:26.601895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c0f3724e-a2fd-4a1c-9ae8-61a26e2d0fc3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:26.602811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c0f3724e-a2fd-4a1c-9ae8-61a26e2d0fc3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:26.608325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c0f3724e-a2fd-4a1c-9ae8-61a26e2d0fc3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:26.608809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c0f3724e-a2fd-4a1c-9ae8-61a26e2d0fc3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:26.609580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c0f3724e-a2fd-4a1c-9ae8-61a26e2d0fc3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:26.610014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c0f3724e-a2fd-4a1c-9ae8-61a26e2d0fc3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:26.642679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c0f3724e-a2fd-4a1c-9ae8-61a26e2d0fc3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043960 Feb 21 00:44:26.643372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 434/779] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:26.648434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-75842839-a2d5-4639-be2d-d37e8a9caea5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:26.649107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-75842839-a2d5-4639-be2d-d37e8a9caea5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:26.655496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75842839-a2d5-4639-be2d-d37e8a9caea5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:26.655941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75842839-a2d5-4639-be2d-d37e8a9caea5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:26.656762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75842839-a2d5-4639-be2d-d37e8a9caea5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:26.657191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75842839-a2d5-4639-be2d-d37e8a9caea5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:26.717320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-75842839-a2d5-4639-be2d-d37e8a9caea5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:26.725228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-75842839-a2d5-4639-be2d-d37e8a9caea5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080775 Feb 21 00:44:26.725782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 435/780] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:26 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:27.617978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cb619341-7d96-4ce0-b88f-02ef3a8b4bee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:27.619022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cb619341-7d96-4ce0-b88f-02ef3a8b4bee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:27.626790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb619341-7d96-4ce0-b88f-02ef3a8b4bee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:27.627301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb619341-7d96-4ce0-b88f-02ef3a8b4bee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:27.628192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb619341-7d96-4ce0-b88f-02ef3a8b4bee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:27.628728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb619341-7d96-4ce0-b88f-02ef3a8b4bee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:27.785992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cb619341-7d96-4ce0-b88f-02ef3a8b4bee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:27.793717 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cb619341-7d96-4ce0-b88f-02ef3a8b4bee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.181806 Feb 21 00:44:27.794253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 436/781] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:27.798694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9ade4d0b-9ed7-4ecc-a8f0-19c78aae6e09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:27.799584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9ade4d0b-9ed7-4ecc-a8f0-19c78aae6e09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:27.805183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9ade4d0b-9ed7-4ecc-a8f0-19c78aae6e09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:27.805615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9ade4d0b-9ed7-4ecc-a8f0-19c78aae6e09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:27.806368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9ade4d0b-9ed7-4ecc-a8f0-19c78aae6e09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:27.806818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9ade4d0b-9ed7-4ecc-a8f0-19c78aae6e09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:27.835067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9ade4d0b-9ed7-4ecc-a8f0-19c78aae6e09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039815 Feb 21 00:44:27.835607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 437/782] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:27.839617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-517d8a7a-1ed9-4da3-b15a-0889be294a19 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:27.840316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-517d8a7a-1ed9-4da3-b15a-0889be294a19 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:27.845830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-517d8a7a-1ed9-4da3-b15a-0889be294a19 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:27.846267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-517d8a7a-1ed9-4da3-b15a-0889be294a19 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:27.847015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-517d8a7a-1ed9-4da3-b15a-0889be294a19 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:27.847432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-517d8a7a-1ed9-4da3-b15a-0889be294a19 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:27.906877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-517d8a7a-1ed9-4da3-b15a-0889be294a19 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:27.914458 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-517d8a7a-1ed9-4da3-b15a-0889be294a19 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.077951 Feb 21 00:44:27.915020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 438/783] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:27 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:28.814736 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9bab6b0d-82e7-45ab-bd5f-d1b78ae944b9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:28.815749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9bab6b0d-82e7-45ab-bd5f-d1b78ae944b9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:28.824682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bab6b0d-82e7-45ab-bd5f-d1b78ae944b9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:28.825122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bab6b0d-82e7-45ab-bd5f-d1b78ae944b9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:28.825883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bab6b0d-82e7-45ab-bd5f-d1b78ae944b9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:28.826303 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bab6b0d-82e7-45ab-bd5f-d1b78ae944b9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:28.962900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9bab6b0d-82e7-45ab-bd5f-d1b78ae944b9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:28.970232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9bab6b0d-82e7-45ab-bd5f-d1b78ae944b9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161835 Feb 21 00:44:28.971054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 439/784] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:28 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:28.975412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-43430c82-6021-4d3a-bbf6-7560b1c369aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:28.976287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-43430c82-6021-4d3a-bbf6-7560b1c369aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:28.981769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43430c82-6021-4d3a-bbf6-7560b1c369aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:28.982208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43430c82-6021-4d3a-bbf6-7560b1c369aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:28.982969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43430c82-6021-4d3a-bbf6-7560b1c369aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:28.983391 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43430c82-6021-4d3a-bbf6-7560b1c369aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:29.014598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-43430c82-6021-4d3a-bbf6-7560b1c369aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042592 Feb 21 00:44:29.015188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 440/785] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:29.019361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-afb5e5ef-2d34-4772-9283-34b7fe8c86aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:29.019950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-afb5e5ef-2d34-4772-9283-34b7fe8c86aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:29.025456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-afb5e5ef-2d34-4772-9283-34b7fe8c86aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:29.025903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-afb5e5ef-2d34-4772-9283-34b7fe8c86aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:29.026662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-afb5e5ef-2d34-4772-9283-34b7fe8c86aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:29.027088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-afb5e5ef-2d34-4772-9283-34b7fe8c86aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:29.087230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-afb5e5ef-2d34-4772-9283-34b7fe8c86aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:29.094952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-afb5e5ef-2d34-4772-9283-34b7fe8c86aa tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.078764 Feb 21 00:44:29.095548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 441/786] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:29 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:29.990642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8e2015b9-b941-4496-9b1d-98ca3ce7c9b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:29.991735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8e2015b9-b941-4496-9b1d-98ca3ce7c9b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:30.002205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e2015b9-b941-4496-9b1d-98ca3ce7c9b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:30.002889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e2015b9-b941-4496-9b1d-98ca3ce7c9b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:30.004181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e2015b9-b941-4496-9b1d-98ca3ce7c9b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:30.004932 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e2015b9-b941-4496-9b1d-98ca3ce7c9b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:30.141151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8e2015b9-b941-4496-9b1d-98ca3ce7c9b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:30.149160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8e2015b9-b941-4496-9b1d-98ca3ce7c9b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.164745 Feb 21 00:44:30.149717 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 442/787] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:29 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:30.154401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ab0d6fd3-5163-4ead-a0c2-718189c6c265 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:30.155282 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ab0d6fd3-5163-4ead-a0c2-718189c6c265 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:30.161998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ab0d6fd3-5163-4ead-a0c2-718189c6c265 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:30.162439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ab0d6fd3-5163-4ead-a0c2-718189c6c265 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:30.163239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ab0d6fd3-5163-4ead-a0c2-718189c6c265 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:30.163641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ab0d6fd3-5163-4ead-a0c2-718189c6c265 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:30.192241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ab0d6fd3-5163-4ead-a0c2-718189c6c265 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041559 Feb 21 00:44:30.192829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 443/788] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:30.196874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-54b96f17-6f32-4840-bcf5-2116f50d0cd4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:30.197524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-54b96f17-6f32-4840-bcf5-2116f50d0cd4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:30.203229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54b96f17-6f32-4840-bcf5-2116f50d0cd4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:30.203676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54b96f17-6f32-4840-bcf5-2116f50d0cd4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:30.204442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54b96f17-6f32-4840-bcf5-2116f50d0cd4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:30.204900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-54b96f17-6f32-4840-bcf5-2116f50d0cd4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:30.263745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-54b96f17-6f32-4840-bcf5-2116f50d0cd4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:30.271273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-54b96f17-6f32-4840-bcf5-2116f50d0cd4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.077530 Feb 21 00:44:30.271838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 444/789] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:30 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:31.166912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4a0e2ea3-b6f1-4e9d-be59-1bd02b46ea07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:31.167547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4a0e2ea3-b6f1-4e9d-be59-1bd02b46ea07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:31.174310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a0e2ea3-b6f1-4e9d-be59-1bd02b46ea07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:31.174756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a0e2ea3-b6f1-4e9d-be59-1bd02b46ea07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:31.175535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a0e2ea3-b6f1-4e9d-be59-1bd02b46ea07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:31.175964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a0e2ea3-b6f1-4e9d-be59-1bd02b46ea07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:31.315617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4a0e2ea3-b6f1-4e9d-be59-1bd02b46ea07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:31.323466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4a0e2ea3-b6f1-4e9d-be59-1bd02b46ea07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.160276 Feb 21 00:44:31.324025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 445/790] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:31 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:31.328526 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bb786ae8-c128-4a38-9ed9-aefff5aaa3a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:31.329412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bb786ae8-c128-4a38-9ed9-aefff5aaa3a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:31.335573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb786ae8-c128-4a38-9ed9-aefff5aaa3a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:31.336013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb786ae8-c128-4a38-9ed9-aefff5aaa3a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:31.336863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb786ae8-c128-4a38-9ed9-aefff5aaa3a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:31.337293 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb786ae8-c128-4a38-9ed9-aefff5aaa3a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:31.367236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bb786ae8-c128-4a38-9ed9-aefff5aaa3a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042196 Feb 21 00:44:31.367785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 446/791] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:31.372034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5ca1cdb6-9fff-4bdb-beb5-2e5cc8c5602e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:31.372661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5ca1cdb6-9fff-4bdb-beb5-2e5cc8c5602e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:31.378269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ca1cdb6-9fff-4bdb-beb5-2e5cc8c5602e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:31.378713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ca1cdb6-9fff-4bdb-beb5-2e5cc8c5602e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:31.379474 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ca1cdb6-9fff-4bdb-beb5-2e5cc8c5602e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:31.379903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ca1cdb6-9fff-4bdb-beb5-2e5cc8c5602e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:31.442876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5ca1cdb6-9fff-4bdb-beb5-2e5cc8c5602e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:31.450692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5ca1cdb6-9fff-4bdb-beb5-2e5cc8c5602e tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.081979 Feb 21 00:44:31.451229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 447/792] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:31 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:32.344174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e32023c8-0fd8-4455-b926-05a9cda2cfe6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:32.345340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e32023c8-0fd8-4455-b926-05a9cda2cfe6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:32.355055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e32023c8-0fd8-4455-b926-05a9cda2cfe6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:32.355500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e32023c8-0fd8-4455-b926-05a9cda2cfe6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:32.356270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e32023c8-0fd8-4455-b926-05a9cda2cfe6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:32.356701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e32023c8-0fd8-4455-b926-05a9cda2cfe6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:32.494473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e32023c8-0fd8-4455-b926-05a9cda2cfe6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:32.505405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e32023c8-0fd8-4455-b926-05a9cda2cfe6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.167020 Feb 21 00:44:32.506122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 448/793] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:32 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:32.511007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b9ece7dc-da82-4764-9e24-b1dc10284b4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:32.511904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b9ece7dc-da82-4764-9e24-b1dc10284b4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:32.520680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9ece7dc-da82-4764-9e24-b1dc10284b4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:32.521176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9ece7dc-da82-4764-9e24-b1dc10284b4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:32.522092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9ece7dc-da82-4764-9e24-b1dc10284b4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:32.522549 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9ece7dc-da82-4764-9e24-b1dc10284b4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:32.561568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b9ece7dc-da82-4764-9e24-b1dc10284b4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054098 Feb 21 00:44:32.562236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 449/794] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:32.566712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d4ab1d80-5632-48f5-969d-a1b31a5f56d0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:32.567534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d4ab1d80-5632-48f5-969d-a1b31a5f56d0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:32.574612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4ab1d80-5632-48f5-969d-a1b31a5f56d0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:32.575049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4ab1d80-5632-48f5-969d-a1b31a5f56d0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:32.575823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4ab1d80-5632-48f5-969d-a1b31a5f56d0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:32.576250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4ab1d80-5632-48f5-969d-a1b31a5f56d0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:32.634931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d4ab1d80-5632-48f5-969d-a1b31a5f56d0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:32.642738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d4ab1d80-5632-48f5-969d-a1b31a5f56d0 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.079571 Feb 21 00:44:32.643301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 450/795] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:32 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:33.526272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-886027a5-a001-45f5-afc8-4564b42fdf31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:33.526947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-886027a5-a001-45f5-afc8-4564b42fdf31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:33.533914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-886027a5-a001-45f5-afc8-4564b42fdf31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:33.534330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-886027a5-a001-45f5-afc8-4564b42fdf31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:33.535107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-886027a5-a001-45f5-afc8-4564b42fdf31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:33.535532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-886027a5-a001-45f5-afc8-4564b42fdf31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:33.687871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-886027a5-a001-45f5-afc8-4564b42fdf31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:33.699066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-886027a5-a001-45f5-afc8-4564b42fdf31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.178419 Feb 21 00:44:33.699735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 451/796] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:33 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:33.704107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ffc8b733-0311-4571-97e4-665dde8b624c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:33.705019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ffc8b733-0311-4571-97e4-665dde8b624c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:33.710682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffc8b733-0311-4571-97e4-665dde8b624c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:33.711121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffc8b733-0311-4571-97e4-665dde8b624c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:33.711926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffc8b733-0311-4571-97e4-665dde8b624c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:33.712349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffc8b733-0311-4571-97e4-665dde8b624c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:33.741400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ffc8b733-0311-4571-97e4-665dde8b624c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040668 Feb 21 00:44:33.741938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 452/797] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:33.861259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-33eab552-dc54-4d58-99e8-7c8fa376968c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:33.861869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-33eab552-dc54-4d58-99e8-7c8fa376968c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:33.868490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33eab552-dc54-4d58-99e8-7c8fa376968c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:33.868942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33eab552-dc54-4d58-99e8-7c8fa376968c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:33.869709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33eab552-dc54-4d58-99e8-7c8fa376968c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:33.870133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33eab552-dc54-4d58-99e8-7c8fa376968c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:33.940591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-33eab552-dc54-4d58-99e8-7c8fa376968c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:33.949025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-33eab552-dc54-4d58-99e8-7c8fa376968c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.206178 Feb 21 00:44:33.949590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 453/798] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:33 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:34.720127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bc439fba-5deb-4b03-bdb0-c9e6068d9653 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:34.721177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bc439fba-5deb-4b03-bdb0-c9e6068d9653 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:34.730621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc439fba-5deb-4b03-bdb0-c9e6068d9653 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:34.731069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc439fba-5deb-4b03-bdb0-c9e6068d9653 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:34.731833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc439fba-5deb-4b03-bdb0-c9e6068d9653 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:34.732262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc439fba-5deb-4b03-bdb0-c9e6068d9653 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:34.868937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bc439fba-5deb-4b03-bdb0-c9e6068d9653 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:34.876690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bc439fba-5deb-4b03-bdb0-c9e6068d9653 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.162755 Feb 21 00:44:34.877264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 454/799] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:34 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:34.881569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-98dc25f1-e1ef-42ec-b0e9-47e4f6651c85 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:34.882536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-98dc25f1-e1ef-42ec-b0e9-47e4f6651c85 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:34.888418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98dc25f1-e1ef-42ec-b0e9-47e4f6651c85 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:34.888856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98dc25f1-e1ef-42ec-b0e9-47e4f6651c85 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:34.889630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98dc25f1-e1ef-42ec-b0e9-47e4f6651c85 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:34.890062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98dc25f1-e1ef-42ec-b0e9-47e4f6651c85 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:34.922835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-98dc25f1-e1ef-42ec-b0e9-47e4f6651c85 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044213 Feb 21 00:44:34.923564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 455/800] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:34.970086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0f24c346-b05e-403c-920f-8f55baa529a4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:34.971069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0f24c346-b05e-403c-920f-8f55baa529a4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:34.980899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f24c346-b05e-403c-920f-8f55baa529a4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:34.981645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f24c346-b05e-403c-920f-8f55baa529a4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:34.982905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f24c346-b05e-403c-920f-8f55baa529a4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:34.983677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f24c346-b05e-403c-920f-8f55baa529a4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:35.051018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0f24c346-b05e-403c-920f-8f55baa529a4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:35.061273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0f24c346-b05e-403c-920f-8f55baa529a4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.096948 Feb 21 00:44:35.061884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 456/801] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:34 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:35.897561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-820ae211-b77c-4a96-8bd9-c2b1dd41edc4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:35.898584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-820ae211-b77c-4a96-8bd9-c2b1dd41edc4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:35.906758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-820ae211-b77c-4a96-8bd9-c2b1dd41edc4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:35.907250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-820ae211-b77c-4a96-8bd9-c2b1dd41edc4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:35.908106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-820ae211-b77c-4a96-8bd9-c2b1dd41edc4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:35.909085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-820ae211-b77c-4a96-8bd9-c2b1dd41edc4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:36.061968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-820ae211-b77c-4a96-8bd9-c2b1dd41edc4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:36.069827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-820ae211-b77c-4a96-8bd9-c2b1dd41edc4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.178572 Feb 21 00:44:36.070437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 457/802] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:35 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:36.074811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f70d2096-02e0-4e34-a752-f6529345feec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:36.075750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f70d2096-02e0-4e34-a752-f6529345feec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:36.081403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f70d2096-02e0-4e34-a752-f6529345feec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:36.081845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f70d2096-02e0-4e34-a752-f6529345feec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:36.082612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f70d2096-02e0-4e34-a752-f6529345feec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:36.083040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f70d2096-02e0-4e34-a752-f6529345feec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:36.112421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f70d2096-02e0-4e34-a752-f6529345feec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040993 Feb 21 00:44:36.112989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 458/803] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:36 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:36.117041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bef7ee36-835a-4361-aa2d-c1e0296f3248 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:36.117629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bef7ee36-835a-4361-aa2d-c1e0296f3248 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:36.123374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bef7ee36-835a-4361-aa2d-c1e0296f3248 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:36.123813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bef7ee36-835a-4361-aa2d-c1e0296f3248 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:36.124614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bef7ee36-835a-4361-aa2d-c1e0296f3248 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:36.125041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bef7ee36-835a-4361-aa2d-c1e0296f3248 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:36.194153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bef7ee36-835a-4361-aa2d-c1e0296f3248 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:36.201930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bef7ee36-835a-4361-aa2d-c1e0296f3248 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.088028 Feb 21 00:44:36.202496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 459/804] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:36 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:37.089718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bc98a007-8f1d-4c30-8858-1eec8605c741 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:37.090399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bc98a007-8f1d-4c30-8858-1eec8605c741 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:37.097247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc98a007-8f1d-4c30-8858-1eec8605c741 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:37.097695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc98a007-8f1d-4c30-8858-1eec8605c741 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:37.098460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc98a007-8f1d-4c30-8858-1eec8605c741 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:37.098879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc98a007-8f1d-4c30-8858-1eec8605c741 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:37.237460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bc98a007-8f1d-4c30-8858-1eec8605c741 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:37.245393 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bc98a007-8f1d-4c30-8858-1eec8605c741 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.160951 Feb 21 00:44:37.245957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 460/805] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:37.250302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4037268c-f026-4007-902d-206440259839 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:37.251184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4037268c-f026-4007-902d-206440259839 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:37.256633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4037268c-f026-4007-902d-206440259839 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:37.257072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4037268c-f026-4007-902d-206440259839 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:37.257831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4037268c-f026-4007-902d-206440259839 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:37.258250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4037268c-f026-4007-902d-206440259839 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:37.287980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4037268c-f026-4007-902d-206440259839 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041047 Feb 21 00:44:37.288547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 461/806] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:37 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:37.292633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9352ba96-9dc3-4f7c-bd47-93155ac8f7f1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:37.293219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9352ba96-9dc3-4f7c-bd47-93155ac8f7f1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:37.298740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9352ba96-9dc3-4f7c-bd47-93155ac8f7f1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:37.299182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9352ba96-9dc3-4f7c-bd47-93155ac8f7f1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:37.299933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9352ba96-9dc3-4f7c-bd47-93155ac8f7f1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:37.300356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9352ba96-9dc3-4f7c-bd47-93155ac8f7f1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:37.357962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9352ba96-9dc3-4f7c-bd47-93155ac8f7f1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:37.365342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9352ba96-9dc3-4f7c-bd47-93155ac8f7f1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.075893 Feb 21 00:44:37.365916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 462/807] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:37 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:38.263236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7075d869-ef9c-4840-acde-a8ac930e5a6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:38.263901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7075d869-ef9c-4840-acde-a8ac930e5a6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:38.273580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7075d869-ef9c-4840-acde-a8ac930e5a6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:38.274184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7075d869-ef9c-4840-acde-a8ac930e5a6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:38.275431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7075d869-ef9c-4840-acde-a8ac930e5a6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:38.276097 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7075d869-ef9c-4840-acde-a8ac930e5a6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:38.425654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7075d869-ef9c-4840-acde-a8ac930e5a6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:38.437036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7075d869-ef9c-4840-acde-a8ac930e5a6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.177824 Feb 21 00:44:38.437914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 463/808] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:38 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:38.443838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cbc7daa9-0a9f-4793-9d96-b8c614c1fc4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:38.445292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cbc7daa9-0a9f-4793-9d96-b8c614c1fc4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:38.452043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbc7daa9-0a9f-4793-9d96-b8c614c1fc4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:38.452519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbc7daa9-0a9f-4793-9d96-b8c614c1fc4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:38.453286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbc7daa9-0a9f-4793-9d96-b8c614c1fc4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:38.453710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbc7daa9-0a9f-4793-9d96-b8c614c1fc4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:38.484412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cbc7daa9-0a9f-4793-9d96-b8c614c1fc4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045324 Feb 21 00:44:38.484962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 464/809] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:38.489115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-30cd0fd0-8337-4272-99f1-008aac65e84d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:38.489672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-30cd0fd0-8337-4272-99f1-008aac65e84d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:38.495440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30cd0fd0-8337-4272-99f1-008aac65e84d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:38.495878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30cd0fd0-8337-4272-99f1-008aac65e84d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:38.496667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30cd0fd0-8337-4272-99f1-008aac65e84d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:38.497130 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30cd0fd0-8337-4272-99f1-008aac65e84d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:38.558088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-30cd0fd0-8337-4272-99f1-008aac65e84d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:38.566230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-30cd0fd0-8337-4272-99f1-008aac65e84d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080345 Feb 21 00:44:38.566891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 465/810] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:38 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:39.458589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3040bb32-0461-433f-97d0-ccb045d12b55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:39.459266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3040bb32-0461-433f-97d0-ccb045d12b55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:39.466098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3040bb32-0461-433f-97d0-ccb045d12b55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:39.466566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3040bb32-0461-433f-97d0-ccb045d12b55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:39.467342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3040bb32-0461-433f-97d0-ccb045d12b55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:39.467799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3040bb32-0461-433f-97d0-ccb045d12b55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:39.685371 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3040bb32-0461-433f-97d0-ccb045d12b55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:39.694495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3040bb32-0461-433f-97d0-ccb045d12b55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.239836 Feb 21 00:44:39.695069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 466/811] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:39 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:39.707587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-39aeeda0-5346-42a8-831a-896ca28e8f22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:39.708533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-39aeeda0-5346-42a8-831a-896ca28e8f22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:39.714424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39aeeda0-5346-42a8-831a-896ca28e8f22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:39.714861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39aeeda0-5346-42a8-831a-896ca28e8f22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:39.715629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39aeeda0-5346-42a8-831a-896ca28e8f22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:39.716054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39aeeda0-5346-42a8-831a-896ca28e8f22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:39.744872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-39aeeda0-5346-42a8-831a-896ca28e8f22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048746 Feb 21 00:44:39.745431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 467/812] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:39.749627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7dfed0b8-f215-42d1-b232-693e6c4c0f95 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:39.750197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7dfed0b8-f215-42d1-b232-693e6c4c0f95 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:39.755830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7dfed0b8-f215-42d1-b232-693e6c4c0f95 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:39.756271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7dfed0b8-f215-42d1-b232-693e6c4c0f95 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:39.757064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7dfed0b8-f215-42d1-b232-693e6c4c0f95 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:39.757493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7dfed0b8-f215-42d1-b232-693e6c4c0f95 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:39.825098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7dfed0b8-f215-42d1-b232-693e6c4c0f95 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:39.832621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7dfed0b8-f215-42d1-b232-693e6c4c0f95 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.086147 Feb 21 00:44:39.833106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 468/813] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:39 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:40.712256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-33bd75d4-b6b0-4332-8c00-83b0d0a37e26 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:40.712890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-33bd75d4-b6b0-4332-8c00-83b0d0a37e26 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:40.719468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33bd75d4-b6b0-4332-8c00-83b0d0a37e26 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:40.719910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33bd75d4-b6b0-4332-8c00-83b0d0a37e26 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:40.720816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33bd75d4-b6b0-4332-8c00-83b0d0a37e26 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:40.721261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33bd75d4-b6b0-4332-8c00-83b0d0a37e26 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:40.857733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-33bd75d4-b6b0-4332-8c00-83b0d0a37e26 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:40.868146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-33bd75d4-b6b0-4332-8c00-83b0d0a37e26 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.159360 Feb 21 00:44:40.868935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 469/814] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:40 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:40.873472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3581ff0d-93ea-4c3a-93ea-e79b4958a98b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:40.874375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3581ff0d-93ea-4c3a-93ea-e79b4958a98b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:40.880129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3581ff0d-93ea-4c3a-93ea-e79b4958a98b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:40.880611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3581ff0d-93ea-4c3a-93ea-e79b4958a98b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:40.881386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3581ff0d-93ea-4c3a-93ea-e79b4958a98b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:40.881813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3581ff0d-93ea-4c3a-93ea-e79b4958a98b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:40.910876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3581ff0d-93ea-4c3a-93ea-e79b4958a98b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040860 Feb 21 00:44:40.911427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 470/815] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:40 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:40.915616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d6044987-e067-4f70-937d-a59629bc5b24 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:40.916203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d6044987-e067-4f70-937d-a59629bc5b24 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:40.921814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d6044987-e067-4f70-937d-a59629bc5b24 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:40.922251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d6044987-e067-4f70-937d-a59629bc5b24 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:40.923008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d6044987-e067-4f70-937d-a59629bc5b24 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:40.923435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d6044987-e067-4f70-937d-a59629bc5b24 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:40.982837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d6044987-e067-4f70-937d-a59629bc5b24 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:40.990791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d6044987-e067-4f70-937d-a59629bc5b24 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.078388 Feb 21 00:44:40.991366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 471/816] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:40 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:41.889378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6961115a-ffb5-46f5-9a0a-59bf630885e7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:41.890429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6961115a-ffb5-46f5-9a0a-59bf630885e7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:41.900653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6961115a-ffb5-46f5-9a0a-59bf630885e7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:41.901092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6961115a-ffb5-46f5-9a0a-59bf630885e7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:41.901866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6961115a-ffb5-46f5-9a0a-59bf630885e7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:41.902294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6961115a-ffb5-46f5-9a0a-59bf630885e7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:42.049625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6961115a-ffb5-46f5-9a0a-59bf630885e7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:42.057892 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6961115a-ffb5-46f5-9a0a-59bf630885e7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.174744 Feb 21 00:44:42.058467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 472/817] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:42.062917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-27585de3-342f-4115-a0ca-cc47a7fbfb49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:42.063819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-27585de3-342f-4115-a0ca-cc47a7fbfb49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:42.069696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27585de3-342f-4115-a0ca-cc47a7fbfb49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:42.070136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27585de3-342f-4115-a0ca-cc47a7fbfb49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:42.070907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27585de3-342f-4115-a0ca-cc47a7fbfb49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:42.071331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27585de3-342f-4115-a0ca-cc47a7fbfb49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:42.100057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-27585de3-342f-4115-a0ca-cc47a7fbfb49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040520 Feb 21 00:44:42.100634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 473/818] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:42.104913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-30616d6b-7e19-4150-84a3-2da6616032cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:42.105504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-30616d6b-7e19-4150-84a3-2da6616032cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:42.110940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30616d6b-7e19-4150-84a3-2da6616032cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:42.111379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30616d6b-7e19-4150-84a3-2da6616032cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:42.112134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30616d6b-7e19-4150-84a3-2da6616032cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:42.112599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30616d6b-7e19-4150-84a3-2da6616032cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:42.178847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-30616d6b-7e19-4150-84a3-2da6616032cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:42.186281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-30616d6b-7e19-4150-84a3-2da6616032cc tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.084711 Feb 21 00:44:42.186882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 474/819] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:42 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:43.074463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d1c41135-3a86-429f-b876-2dcf1ddfac11 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:43.075185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d1c41135-3a86-429f-b876-2dcf1ddfac11 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:43.081886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1c41135-3a86-429f-b876-2dcf1ddfac11 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:43.082326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1c41135-3a86-429f-b876-2dcf1ddfac11 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:43.083090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1c41135-3a86-429f-b876-2dcf1ddfac11 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:43.083513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1c41135-3a86-429f-b876-2dcf1ddfac11 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:43.228033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d1c41135-3a86-429f-b876-2dcf1ddfac11 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:43.239855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d1c41135-3a86-429f-b876-2dcf1ddfac11 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.168930 Feb 21 00:44:43.240754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 475/820] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:43 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:43.246122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e524e65d-ebc4-4c14-8a09-76c4b14a1cd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:43.247008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e524e65d-ebc4-4c14-8a09-76c4b14a1cd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:43.252935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e524e65d-ebc4-4c14-8a09-76c4b14a1cd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:43.253375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e524e65d-ebc4-4c14-8a09-76c4b14a1cd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:43.254140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e524e65d-ebc4-4c14-8a09-76c4b14a1cd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:43.254535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e524e65d-ebc4-4c14-8a09-76c4b14a1cd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:43.285499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e524e65d-ebc4-4c14-8a09-76c4b14a1cd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043581 Feb 21 00:44:43.286049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 476/821] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:43.290165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-90b463d4-dde9-4681-9999-bb5a734ff794 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:43.290750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-90b463d4-dde9-4681-9999-bb5a734ff794 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:43.296263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90b463d4-dde9-4681-9999-bb5a734ff794 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:43.296730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90b463d4-dde9-4681-9999-bb5a734ff794 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:43.297483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90b463d4-dde9-4681-9999-bb5a734ff794 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:43.297910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90b463d4-dde9-4681-9999-bb5a734ff794 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:43.355381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-90b463d4-dde9-4681-9999-bb5a734ff794 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:43.362667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-90b463d4-dde9-4681-9999-bb5a734ff794 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.075702 Feb 21 00:44:43.363214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 477/822] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:43 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:44.262808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b086d0ed-c4bb-4e56-b983-9fe9b4867ff4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:44.263881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b086d0ed-c4bb-4e56-b983-9fe9b4867ff4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:44.274586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b086d0ed-c4bb-4e56-b983-9fe9b4867ff4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:44.275349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b086d0ed-c4bb-4e56-b983-9fe9b4867ff4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:44.277373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b086d0ed-c4bb-4e56-b983-9fe9b4867ff4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:44.278403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b086d0ed-c4bb-4e56-b983-9fe9b4867ff4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:44.418838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b086d0ed-c4bb-4e56-b983-9fe9b4867ff4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:44.430093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b086d0ed-c4bb-4e56-b983-9fe9b4867ff4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.173367 Feb 21 00:44:44.430868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 478/823] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:44 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:44.435160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-148c131d-b078-4e70-b608-521936d17732 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:44.436044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-148c131d-b078-4e70-b608-521936d17732 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:44.442437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-148c131d-b078-4e70-b608-521936d17732 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:44.443047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-148c131d-b078-4e70-b608-521936d17732 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:44.444176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-148c131d-b078-4e70-b608-521936d17732 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:44.444847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-148c131d-b078-4e70-b608-521936d17732 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:44.474598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-148c131d-b078-4e70-b608-521936d17732 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042775 Feb 21 00:44:44.475136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 479/824] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:44 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:44.479188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0a843d55-ad07-4bdd-ae9b-39aceb60c5c8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:44.479770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0a843d55-ad07-4bdd-ae9b-39aceb60c5c8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:44.485487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a843d55-ad07-4bdd-ae9b-39aceb60c5c8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:44.485923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a843d55-ad07-4bdd-ae9b-39aceb60c5c8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:44.486673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a843d55-ad07-4bdd-ae9b-39aceb60c5c8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:44.487091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a843d55-ad07-4bdd-ae9b-39aceb60c5c8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:44.548954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0a843d55-ad07-4bdd-ae9b-39aceb60c5c8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:44.556548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0a843d55-ad07-4bdd-ae9b-39aceb60c5c8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080491 Feb 21 00:44:44.557113 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 480/825] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:44 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:45.451395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-94ad6217-4738-4651-9450-1a812606bb00 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:45.452530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-94ad6217-4738-4651-9450-1a812606bb00 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:45.462834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ad6217-4738-4651-9450-1a812606bb00 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:45.463273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ad6217-4738-4651-9450-1a812606bb00 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:45.464052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ad6217-4738-4651-9450-1a812606bb00 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:45.464508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ad6217-4738-4651-9450-1a812606bb00 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:45.599790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-94ad6217-4738-4651-9450-1a812606bb00 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:45.607206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-94ad6217-4738-4651-9450-1a812606bb00 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161961 Feb 21 00:44:45.607783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 481/826] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:45 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:45.612262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-39fae727-c2ef-4b34-ae94-28160222a751 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:45.613182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-39fae727-c2ef-4b34-ae94-28160222a751 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:45.619259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39fae727-c2ef-4b34-ae94-28160222a751 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:45.619700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39fae727-c2ef-4b34-ae94-28160222a751 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:45.620472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39fae727-c2ef-4b34-ae94-28160222a751 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:45.620902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39fae727-c2ef-4b34-ae94-28160222a751 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:45.648938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-39fae727-c2ef-4b34-ae94-28160222a751 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040208 Feb 21 00:44:45.649489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 482/827] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:45 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:45.653866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d010113c-def4-4d04-8447-747c9a4e76a2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:45.654465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d010113c-def4-4d04-8447-747c9a4e76a2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:45.660306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d010113c-def4-4d04-8447-747c9a4e76a2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:45.660778 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d010113c-def4-4d04-8447-747c9a4e76a2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:45.661541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d010113c-def4-4d04-8447-747c9a4e76a2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:45.661966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d010113c-def4-4d04-8447-747c9a4e76a2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:45.720938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d010113c-def4-4d04-8447-747c9a4e76a2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:45.728319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d010113c-def4-4d04-8447-747c9a4e76a2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.077848 Feb 21 00:44:45.728915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 483/828] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:45 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:46.626554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d7f5d77b-33a5-4343-ac61-e080265e678e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:46.627941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d7f5d77b-33a5-4343-ac61-e080265e678e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:46.637135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7f5d77b-33a5-4343-ac61-e080265e678e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:46.637573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7f5d77b-33a5-4343-ac61-e080265e678e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:46.638340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7f5d77b-33a5-4343-ac61-e080265e678e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:46.638827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d7f5d77b-33a5-4343-ac61-e080265e678e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:46.942720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d7f5d77b-33a5-4343-ac61-e080265e678e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:46.957056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d7f5d77b-33a5-4343-ac61-e080265e678e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.335247 Feb 21 00:44:46.957698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 484/829] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:46 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:46.963834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dda43a2f-d6fc-4ddb-8af1-4ab82d2a809a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:46.964752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dda43a2f-d6fc-4ddb-8af1-4ab82d2a809a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:46.970482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dda43a2f-d6fc-4ddb-8af1-4ab82d2a809a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:46.970918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dda43a2f-d6fc-4ddb-8af1-4ab82d2a809a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:46.971679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dda43a2f-d6fc-4ddb-8af1-4ab82d2a809a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:46.972092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dda43a2f-d6fc-4ddb-8af1-4ab82d2a809a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:47.000515 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dda43a2f-d6fc-4ddb-8af1-4ab82d2a809a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041569 Feb 21 00:44:47.001028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 485/830] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:47.005030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d34b12ac-ffd1-493c-86c9-5eadc55f8e4c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:47.005616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d34b12ac-ffd1-493c-86c9-5eadc55f8e4c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:47.011071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d34b12ac-ffd1-493c-86c9-5eadc55f8e4c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:47.011506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d34b12ac-ffd1-493c-86c9-5eadc55f8e4c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:47.012257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d34b12ac-ffd1-493c-86c9-5eadc55f8e4c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:47.012705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d34b12ac-ffd1-493c-86c9-5eadc55f8e4c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:47.081412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d34b12ac-ffd1-493c-86c9-5eadc55f8e4c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:47.089073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d34b12ac-ffd1-493c-86c9-5eadc55f8e4c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.087129 Feb 21 00:44:47.089636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 486/831] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:47 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:47.978594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-019c90b9-acbd-42b0-b394-876ae75c5d83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:47.979230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-019c90b9-acbd-42b0-b394-876ae75c5d83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:47.986290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-019c90b9-acbd-42b0-b394-876ae75c5d83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:47.986730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-019c90b9-acbd-42b0-b394-876ae75c5d83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:47.987526 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-019c90b9-acbd-42b0-b394-876ae75c5d83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:47.987950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-019c90b9-acbd-42b0-b394-876ae75c5d83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:48.127964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-019c90b9-acbd-42b0-b394-876ae75c5d83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:48.135506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-019c90b9-acbd-42b0-b394-876ae75c5d83 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.163258 Feb 21 00:44:48.136066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 487/832] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:48.140342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cfa8dfc6-6916-4aec-9f7a-3b5074456ea1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:48.141261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cfa8dfc6-6916-4aec-9f7a-3b5074456ea1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:48.146805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cfa8dfc6-6916-4aec-9f7a-3b5074456ea1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:48.147251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cfa8dfc6-6916-4aec-9f7a-3b5074456ea1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:48.148022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cfa8dfc6-6916-4aec-9f7a-3b5074456ea1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:48.148481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cfa8dfc6-6916-4aec-9f7a-3b5074456ea1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:48.178500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cfa8dfc6-6916-4aec-9f7a-3b5074456ea1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041435 Feb 21 00:44:48.179038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 488/833] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:48.183013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-241089a0-db2a-4ff2-adaa-60c84980efe3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:48.183589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-241089a0-db2a-4ff2-adaa-60c84980efe3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:48.189272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-241089a0-db2a-4ff2-adaa-60c84980efe3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:48.189710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-241089a0-db2a-4ff2-adaa-60c84980efe3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:48.190465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-241089a0-db2a-4ff2-adaa-60c84980efe3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:48.190887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-241089a0-db2a-4ff2-adaa-60c84980efe3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:48.248753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-241089a0-db2a-4ff2-adaa-60c84980efe3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:48.256275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-241089a0-db2a-4ff2-adaa-60c84980efe3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.076344 Feb 21 00:44:48.256861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 489/834] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:48 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:49.156680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f89f0b10-2963-4bb6-8b9f-ca2783986612 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:49.157756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f89f0b10-2963-4bb6-8b9f-ca2783986612 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:49.168314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f89f0b10-2963-4bb6-8b9f-ca2783986612 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:49.169102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f89f0b10-2963-4bb6-8b9f-ca2783986612 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:49.170382 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f89f0b10-2963-4bb6-8b9f-ca2783986612 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:49.171093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f89f0b10-2963-4bb6-8b9f-ca2783986612 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:49.325122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f89f0b10-2963-4bb6-8b9f-ca2783986612 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:49.332931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f89f0b10-2963-4bb6-8b9f-ca2783986612 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.182756 Feb 21 00:44:49.333494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 490/835] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:49 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:44:49.337907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-231bb92f-94e4-4423-b8b6-a0b791433473 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:49.338783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-231bb92f-94e4-4423-b8b6-a0b791433473 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:49.344636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-231bb92f-94e4-4423-b8b6-a0b791433473 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:49.345075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-231bb92f-94e4-4423-b8b6-a0b791433473 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:49.345833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-231bb92f-94e4-4423-b8b6-a0b791433473 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:49.346262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-231bb92f-94e4-4423-b8b6-a0b791433473 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:49.377367 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-231bb92f-94e4-4423-b8b6-a0b791433473 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042900 Feb 21 00:44:49.377933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 491/836] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:49.382024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3aa2cc90-2c88-4c92-a332-32bf25c42ae3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:49.382609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3aa2cc90-2c88-4c92-a332-32bf25c42ae3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:49.388571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3aa2cc90-2c88-4c92-a332-32bf25c42ae3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:49.388990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3aa2cc90-2c88-4c92-a332-32bf25c42ae3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:49.389786 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3aa2cc90-2c88-4c92-a332-32bf25c42ae3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:49.390208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3aa2cc90-2c88-4c92-a332-32bf25c42ae3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:49.448828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3aa2cc90-2c88-4c92-a332-32bf25c42ae3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:49.456541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3aa2cc90-2c88-4c92-a332-32bf25c42ae3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.077662 Feb 21 00:44:49.457094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 492/837] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:49 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:50.352894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e195d129-5f5c-46c2-8420-74f7791c064e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:50.353595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e195d129-5f5c-46c2-8420-74f7791c064e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:50.360231 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e195d129-5f5c-46c2-8420-74f7791c064e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:50.360710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e195d129-5f5c-46c2-8420-74f7791c064e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:50.361485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e195d129-5f5c-46c2-8420-74f7791c064e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:50.361913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e195d129-5f5c-46c2-8420-74f7791c064e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:50.505544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e195d129-5f5c-46c2-8420-74f7791c064e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:50.512975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e195d129-5f5c-46c2-8420-74f7791c064e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.166358 Feb 21 00:44:50.513538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 493/838] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:50 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:50.517884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-caf65f1f-8b81-4b2a-ba8e-5744fb3c19f2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:50.518775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-caf65f1f-8b81-4b2a-ba8e-5744fb3c19f2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:50.525073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf65f1f-8b81-4b2a-ba8e-5744fb3c19f2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:50.525537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf65f1f-8b81-4b2a-ba8e-5744fb3c19f2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:50.526459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf65f1f-8b81-4b2a-ba8e-5744fb3c19f2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:50.527066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf65f1f-8b81-4b2a-ba8e-5744fb3c19f2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:50.556151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-caf65f1f-8b81-4b2a-ba8e-5744fb3c19f2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041651 Feb 21 00:44:50.556758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 494/839] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:50 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:50.560894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-242b55fc-7a85-4100-9dde-9a7ecfb18aee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:50.561460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-242b55fc-7a85-4100-9dde-9a7ecfb18aee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:50.566679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-242b55fc-7a85-4100-9dde-9a7ecfb18aee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:50.567121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-242b55fc-7a85-4100-9dde-9a7ecfb18aee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:50.567881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-242b55fc-7a85-4100-9dde-9a7ecfb18aee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:50.568309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-242b55fc-7a85-4100-9dde-9a7ecfb18aee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:50.629450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-242b55fc-7a85-4100-9dde-9a7ecfb18aee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:50.637398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-242b55fc-7a85-4100-9dde-9a7ecfb18aee tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.079726 Feb 21 00:44:50.637949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 495/840] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:50 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:51.534617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-809d1b9a-abef-49ab-80f5-72041fdd03aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:51.535675 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-809d1b9a-abef-49ab-80f5-72041fdd03aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:51.546339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-809d1b9a-abef-49ab-80f5-72041fdd03aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:51.547070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-809d1b9a-abef-49ab-80f5-72041fdd03aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:51.548339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-809d1b9a-abef-49ab-80f5-72041fdd03aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:51.549126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-809d1b9a-abef-49ab-80f5-72041fdd03aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:51.692252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-809d1b9a-abef-49ab-80f5-72041fdd03aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:51.701588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-809d1b9a-abef-49ab-80f5-72041fdd03aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.173402 Feb 21 00:44:51.702146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 496/841] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:51.706583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-99f3390c-51d3-42f1-9535-83e288881afd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:51.707474 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-99f3390c-51d3-42f1-9535-83e288881afd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:51.713863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-99f3390c-51d3-42f1-9535-83e288881afd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:51.714302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-99f3390c-51d3-42f1-9535-83e288881afd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:51.715073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-99f3390c-51d3-42f1-9535-83e288881afd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:51.715496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-99f3390c-51d3-42f1-9535-83e288881afd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:51.751840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-99f3390c-51d3-42f1-9535-83e288881afd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048301 Feb 21 00:44:51.752641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 497/842] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:51 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:51.757163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-07d534f6-55fe-4b94-8f7d-e6395555627a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:51.758020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-07d534f6-55fe-4b94-8f7d-e6395555627a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:51.763681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-07d534f6-55fe-4b94-8f7d-e6395555627a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:51.764131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-07d534f6-55fe-4b94-8f7d-e6395555627a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:51.764934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-07d534f6-55fe-4b94-8f7d-e6395555627a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:51.765365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-07d534f6-55fe-4b94-8f7d-e6395555627a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:51.833911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-07d534f6-55fe-4b94-8f7d-e6395555627a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:51.841446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-07d534f6-55fe-4b94-8f7d-e6395555627a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.087873 Feb 21 00:44:51.842007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 498/843] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:51 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:52.722228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7dbf8015-1303-429c-8661-3489c7c36b58 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:52.723207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7dbf8015-1303-429c-8661-3489c7c36b58 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:52.733249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7dbf8015-1303-429c-8661-3489c7c36b58 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:52.733685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7dbf8015-1303-429c-8661-3489c7c36b58 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:52.734462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7dbf8015-1303-429c-8661-3489c7c36b58 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:52.734866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7dbf8015-1303-429c-8661-3489c7c36b58 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:52.874172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7dbf8015-1303-429c-8661-3489c7c36b58 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:52.882306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7dbf8015-1303-429c-8661-3489c7c36b58 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.166162 Feb 21 00:44:52.882904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 499/844] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:52.887505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dd35e9ae-5ac5-41c1-8e8c-faec97740d95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:52.888414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dd35e9ae-5ac5-41c1-8e8c-faec97740d95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:52.894542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd35e9ae-5ac5-41c1-8e8c-faec97740d95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:52.894981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd35e9ae-5ac5-41c1-8e8c-faec97740d95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:52.895803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd35e9ae-5ac5-41c1-8e8c-faec97740d95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:52.896230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd35e9ae-5ac5-41c1-8e8c-faec97740d95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:52.924754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dd35e9ae-5ac5-41c1-8e8c-faec97740d95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040778 Feb 21 00:44:52.925322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 500/845] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:52.929362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d849dbaf-a7fa-49e5-8925-640187f38ca3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:52.929943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d849dbaf-a7fa-49e5-8925-640187f38ca3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:52.935383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d849dbaf-a7fa-49e5-8925-640187f38ca3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:52.935820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d849dbaf-a7fa-49e5-8925-640187f38ca3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:52.936608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d849dbaf-a7fa-49e5-8925-640187f38ca3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:52.937030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d849dbaf-a7fa-49e5-8925-640187f38ca3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:52.995971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d849dbaf-a7fa-49e5-8925-640187f38ca3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:53.003461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d849dbaf-a7fa-49e5-8925-640187f38ca3 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.077210 Feb 21 00:44:53.004024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 501/846] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:52 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:53.904118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d37ce6c3-bd94-45c5-81c8-d38925e7329f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:53.905465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d37ce6c3-bd94-45c5-81c8-d38925e7329f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:53.915667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d37ce6c3-bd94-45c5-81c8-d38925e7329f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:53.916453 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d37ce6c3-bd94-45c5-81c8-d38925e7329f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:53.917733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d37ce6c3-bd94-45c5-81c8-d38925e7329f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:53.918443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d37ce6c3-bd94-45c5-81c8-d38925e7329f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:54.060178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d37ce6c3-bd94-45c5-81c8-d38925e7329f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:54.067593 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d37ce6c3-bd94-45c5-81c8-d38925e7329f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.170403 Feb 21 00:44:54.068126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 502/847] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:53 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:54.072534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1bd3b846-554f-4ac9-90e3-2b81ded49041 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:54.073428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1bd3b846-554f-4ac9-90e3-2b81ded49041 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:54.079246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bd3b846-554f-4ac9-90e3-2b81ded49041 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:54.079684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bd3b846-554f-4ac9-90e3-2b81ded49041 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:54.080532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bd3b846-554f-4ac9-90e3-2b81ded49041 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:54.080956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bd3b846-554f-4ac9-90e3-2b81ded49041 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:54.109173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1bd3b846-554f-4ac9-90e3-2b81ded49041 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040029 Feb 21 00:44:54.109716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 503/848] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:54 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:54.113886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-60583bad-9f8d-4e65-878c-c87e40cdd791 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:54.114483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-60583bad-9f8d-4e65-878c-c87e40cdd791 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:54.120069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60583bad-9f8d-4e65-878c-c87e40cdd791 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:54.120530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60583bad-9f8d-4e65-878c-c87e40cdd791 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:54.121319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60583bad-9f8d-4e65-878c-c87e40cdd791 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:54.121753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60583bad-9f8d-4e65-878c-c87e40cdd791 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:54.180511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-60583bad-9f8d-4e65-878c-c87e40cdd791 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:54.188156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-60583bad-9f8d-4e65-878c-c87e40cdd791 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.077465 Feb 21 00:44:54.188752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 504/849] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:54 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:55.088042 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7a6b8bca-b5f1-43e0-a627-b8aa5da361f2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:55.088835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7a6b8bca-b5f1-43e0-a627-b8aa5da361f2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:55.095555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a6b8bca-b5f1-43e0-a627-b8aa5da361f2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:55.096014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a6b8bca-b5f1-43e0-a627-b8aa5da361f2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:55.096873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a6b8bca-b5f1-43e0-a627-b8aa5da361f2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:55.097311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a6b8bca-b5f1-43e0-a627-b8aa5da361f2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:55.239490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:44:55.239984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:44:55.241292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7a6b8bca-b5f1-43e0-a627-b8aa5da361f2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:55.248993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7a6b8bca-b5f1-43e0-a627-b8aa5da361f2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.166734 Feb 21 00:44:55.249549 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 505/850] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:55.254130 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-141e749e-ac08-4e8d-b498-65543ee459ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:55.255031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-141e749e-ac08-4e8d-b498-65543ee459ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:55.260735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-141e749e-ac08-4e8d-b498-65543ee459ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:55.261170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-141e749e-ac08-4e8d-b498-65543ee459ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:55.261943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-141e749e-ac08-4e8d-b498-65543ee459ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:55.262369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-141e749e-ac08-4e8d-b498-65543ee459ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:55.291178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-141e749e-ac08-4e8d-b498-65543ee459ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040656 Feb 21 00:44:55.291718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 506/851] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:55.295934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d2e2b0fc-5a26-4a93-96f6-a5e333343e59 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:55.296550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d2e2b0fc-5a26-4a93-96f6-a5e333343e59 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:55.302013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d2e2b0fc-5a26-4a93-96f6-a5e333343e59 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:55.302455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d2e2b0fc-5a26-4a93-96f6-a5e333343e59 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:55.303215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d2e2b0fc-5a26-4a93-96f6-a5e333343e59 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:55.303637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d2e2b0fc-5a26-4a93-96f6-a5e333343e59 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:55.367349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d2e2b0fc-5a26-4a93-96f6-a5e333343e59 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:55.375561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d2e2b0fc-5a26-4a93-96f6-a5e333343e59 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.082948 Feb 21 00:44:55.376126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 507/852] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:55 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:56.267500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5f002151-2a4b-4db0-ae77-77e8edc7c7ee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:56.268379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5f002151-2a4b-4db0-ae77-77e8edc7c7ee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:56.276819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f002151-2a4b-4db0-ae77-77e8edc7c7ee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:56.277380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f002151-2a4b-4db0-ae77-77e8edc7c7ee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:56.278763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f002151-2a4b-4db0-ae77-77e8edc7c7ee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:56.279354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f002151-2a4b-4db0-ae77-77e8edc7c7ee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:56.425076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5f002151-2a4b-4db0-ae77-77e8edc7c7ee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:56.433184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5f002151-2a4b-4db0-ae77-77e8edc7c7ee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.170377 Feb 21 00:44:56.433754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 508/853] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:56.438087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-84418e66-3bbc-4b00-8717-c1641a42cf18 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:56.438976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-84418e66-3bbc-4b00-8717-c1641a42cf18 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:56.444929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84418e66-3bbc-4b00-8717-c1641a42cf18 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:56.445373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84418e66-3bbc-4b00-8717-c1641a42cf18 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:56.446277 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84418e66-3bbc-4b00-8717-c1641a42cf18 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:56.446681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84418e66-3bbc-4b00-8717-c1641a42cf18 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:56.478332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-84418e66-3bbc-4b00-8717-c1641a42cf18 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043558 Feb 21 00:44:56.478885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 509/854] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:56 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:56.482964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-33ace30f-20bc-43ba-b919-958e0810f5b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:56.483554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-33ace30f-20bc-43ba-b919-958e0810f5b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:56.489387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33ace30f-20bc-43ba-b919-958e0810f5b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:56.489826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33ace30f-20bc-43ba-b919-958e0810f5b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:56.490629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33ace30f-20bc-43ba-b919-958e0810f5b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:56.491055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33ace30f-20bc-43ba-b919-958e0810f5b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:56.781111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-33ace30f-20bc-43ba-b919-958e0810f5b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:56.793346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-33ace30f-20bc-43ba-b919-958e0810f5b1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.313246 Feb 21 00:44:56.794268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 510/855] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:56 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:57.450091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-84dbcbf7-5f25-4744-a78f-5835942ad5f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:57.450815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-84dbcbf7-5f25-4744-a78f-5835942ad5f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:57.457179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84dbcbf7-5f25-4744-a78f-5835942ad5f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:57.457623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84dbcbf7-5f25-4744-a78f-5835942ad5f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:57.458407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84dbcbf7-5f25-4744-a78f-5835942ad5f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:57.458833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84dbcbf7-5f25-4744-a78f-5835942ad5f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:57.595080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-84dbcbf7-5f25-4744-a78f-5835942ad5f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:57.602879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-84dbcbf7-5f25-4744-a78f-5835942ad5f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.156672 Feb 21 00:44:57.603441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 511/856] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:57.607729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-083314ae-2840-471e-8f54-b4207a4ba4d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:57.608592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-083314ae-2840-471e-8f54-b4207a4ba4d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:57.614545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-083314ae-2840-471e-8f54-b4207a4ba4d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:57.614978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-083314ae-2840-471e-8f54-b4207a4ba4d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:57.615743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-083314ae-2840-471e-8f54-b4207a4ba4d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:57.616159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-083314ae-2840-471e-8f54-b4207a4ba4d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:57.645087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-083314ae-2840-471e-8f54-b4207a4ba4d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040661 Feb 21 00:44:57.645620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 512/857] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:57 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:57.813949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-56803d84-46fe-4dfc-8010-6fb822923741 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:57.814954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-56803d84-46fe-4dfc-8010-6fb822923741 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:57.823480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56803d84-46fe-4dfc-8010-6fb822923741 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:57.823918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56803d84-46fe-4dfc-8010-6fb822923741 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:57.824746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56803d84-46fe-4dfc-8010-6fb822923741 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:57.825173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56803d84-46fe-4dfc-8010-6fb822923741 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:57.883727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-56803d84-46fe-4dfc-8010-6fb822923741 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:57.891502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-56803d84-46fe-4dfc-8010-6fb822923741 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.083375 Feb 21 00:44:57.892061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 513/858] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:57 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:58.624454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ed74c357-c563-4f85-b139-e92ce4e6f895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:58.625074 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ed74c357-c563-4f85-b139-e92ce4e6f895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:58.634484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ed74c357-c563-4f85-b139-e92ce4e6f895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:58.635136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ed74c357-c563-4f85-b139-e92ce4e6f895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:58.636502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ed74c357-c563-4f85-b139-e92ce4e6f895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:58.637368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ed74c357-c563-4f85-b139-e92ce4e6f895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:58.786898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ed74c357-c563-4f85-b139-e92ce4e6f895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:58.794366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ed74c357-c563-4f85-b139-e92ce4e6f895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.176384 Feb 21 00:44:58.794920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 514/859] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:58 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:58.799193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-85b88b6a-1264-4001-97e7-e1ee4ae85968 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:58.800080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-85b88b6a-1264-4001-97e7-e1ee4ae85968 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:58.805871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-85b88b6a-1264-4001-97e7-e1ee4ae85968 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:58.806322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-85b88b6a-1264-4001-97e7-e1ee4ae85968 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:58.807078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-85b88b6a-1264-4001-97e7-e1ee4ae85968 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:58.807502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-85b88b6a-1264-4001-97e7-e1ee4ae85968 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:58.835711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-85b88b6a-1264-4001-97e7-e1ee4ae85968 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039819 Feb 21 00:44:58.836235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 515/860] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:44:58.911629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f95828e9-82e4-4e41-83cf-bac54771e2b4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:58.912726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f95828e9-82e4-4e41-83cf-bac54771e2b4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:58.922462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f95828e9-82e4-4e41-83cf-bac54771e2b4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:58.923210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f95828e9-82e4-4e41-83cf-bac54771e2b4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:58.924516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f95828e9-82e4-4e41-83cf-bac54771e2b4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:58.925257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f95828e9-82e4-4e41-83cf-bac54771e2b4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:58.991038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f95828e9-82e4-4e41-83cf-bac54771e2b4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:58.999334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f95828e9-82e4-4e41-83cf-bac54771e2b4 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.093437 Feb 21 00:44:58.999903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 516/861] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:58 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:59.636091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:44:59.636833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:44:59.814941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c230acf5-9ec5-438c-8dd3-864c5081f502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:59.815991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c230acf5-9ec5-438c-8dd3-864c5081f502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:59.826782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c230acf5-9ec5-438c-8dd3-864c5081f502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:59.827526 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c230acf5-9ec5-438c-8dd3-864c5081f502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:59.828890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c230acf5-9ec5-438c-8dd3-864c5081f502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:59.829630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c230acf5-9ec5-438c-8dd3-864c5081f502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:59.973523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c230acf5-9ec5-438c-8dd3-864c5081f502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:44:59.982637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c230acf5-9ec5-438c-8dd3-864c5081f502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.173959 Feb 21 00:44:59.983195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 517/862] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:44:59 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:44:59.987451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-faa14fd4-5624-42c2-91b2-8726f30270a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:44:59.988336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-faa14fd4-5624-42c2-91b2-8726f30270a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:44:59.993927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-faa14fd4-5624-42c2-91b2-8726f30270a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:59.994376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-faa14fd4-5624-42c2-91b2-8726f30270a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:44:59.995153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-faa14fd4-5624-42c2-91b2-8726f30270a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:44:59.995625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-faa14fd4-5624-42c2-91b2-8726f30270a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:00.026227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-faa14fd4-5624-42c2-91b2-8726f30270a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042030 Feb 21 00:45:00.026782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 518/863] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:44:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:45:00.031337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a2f4af1d-46ce-4955-9f4d-aa476cd52742 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:00.031902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a2f4af1d-46ce-4955-9f4d-aa476cd52742 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:00.037779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2f4af1d-46ce-4955-9f4d-aa476cd52742 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:00.038221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2f4af1d-46ce-4955-9f4d-aa476cd52742 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:00.038992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2f4af1d-46ce-4955-9f4d-aa476cd52742 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:00.039423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2f4af1d-46ce-4955-9f4d-aa476cd52742 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:00.098117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a2f4af1d-46ce-4955-9f4d-aa476cd52742 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:45:00.105713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a2f4af1d-46ce-4955-9f4d-aa476cd52742 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.077955 Feb 21 00:45:00.106275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 519/864] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:45:00 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:45:00.999385 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-11447701-2192-4680-8caa-9d7abef3dbeb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:00.999990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-11447701-2192-4680-8caa-9d7abef3dbeb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:01.007005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11447701-2192-4680-8caa-9d7abef3dbeb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:01.007438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11447701-2192-4680-8caa-9d7abef3dbeb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:01.008274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11447701-2192-4680-8caa-9d7abef3dbeb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:01.008730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11447701-2192-4680-8caa-9d7abef3dbeb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:01.143871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-11447701-2192-4680-8caa-9d7abef3dbeb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:45:01.151657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-11447701-2192-4680-8caa-9d7abef3dbeb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.156025 Feb 21 00:45:01.152186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 520/865] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:45:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:45:01.156818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bc793a15-9751-4305-8d0e-2fd819418aff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:01.157704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bc793a15-9751-4305-8d0e-2fd819418aff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:01.163323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc793a15-9751-4305-8d0e-2fd819418aff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:01.163761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc793a15-9751-4305-8d0e-2fd819418aff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:01.164589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc793a15-9751-4305-8d0e-2fd819418aff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:01.165012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc793a15-9751-4305-8d0e-2fd819418aff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:01.193702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bc793a15-9751-4305-8d0e-2fd819418aff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040483 Feb 21 00:45:01.194261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 521/866] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:45:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:45:01.198749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1c8e1cdf-bc01-41d1-b02a-9ec43ff8f1a7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:01.199772 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1c8e1cdf-bc01-41d1-b02a-9ec43ff8f1a7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:01.207189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c8e1cdf-bc01-41d1-b02a-9ec43ff8f1a7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:01.207624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c8e1cdf-bc01-41d1-b02a-9ec43ff8f1a7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:01.208381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c8e1cdf-bc01-41d1-b02a-9ec43ff8f1a7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:01.208838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c8e1cdf-bc01-41d1-b02a-9ec43ff8f1a7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:01.268604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1c8e1cdf-bc01-41d1-b02a-9ec43ff8f1a7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:45:01.276017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1c8e1cdf-bc01-41d1-b02a-9ec43ff8f1a7 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080906 Feb 21 00:45:01.276639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 522/867] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:45:01 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:45:02.170268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-133f3de1-dc7a-4e16-ab9e-0d13639cdf34 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:02.171051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-133f3de1-dc7a-4e16-ab9e-0d13639cdf34 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:02.178688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-133f3de1-dc7a-4e16-ab9e-0d13639cdf34 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:02.179217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-133f3de1-dc7a-4e16-ab9e-0d13639cdf34 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:02.180256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-133f3de1-dc7a-4e16-ab9e-0d13639cdf34 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:02.180721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-133f3de1-dc7a-4e16-ab9e-0d13639cdf34 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:02.319767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-133f3de1-dc7a-4e16-ab9e-0d13639cdf34 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:45:02.327721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-133f3de1-dc7a-4e16-ab9e-0d13639cdf34 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.161878 Feb 21 00:45:02.328327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 523/868] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:45:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:45:02.332784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-56e62cf3-c73e-4f38-9995-6ad5b40826cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:02.333684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-56e62cf3-c73e-4f38-9995-6ad5b40826cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:02.339775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56e62cf3-c73e-4f38-9995-6ad5b40826cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:02.340222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56e62cf3-c73e-4f38-9995-6ad5b40826cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:02.341046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56e62cf3-c73e-4f38-9995-6ad5b40826cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:02.341473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56e62cf3-c73e-4f38-9995-6ad5b40826cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:02.371021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-56e62cf3-c73e-4f38-9995-6ad5b40826cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041661 Feb 21 00:45:02.371575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 524/869] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:45:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:45:02.375840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-38a4a9ad-fb3e-4dbf-b713-53b78adb6ad8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:02.376437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-38a4a9ad-fb3e-4dbf-b713-53b78adb6ad8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:02.382332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38a4a9ad-fb3e-4dbf-b713-53b78adb6ad8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:02.382788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38a4a9ad-fb3e-4dbf-b713-53b78adb6ad8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:02.383649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38a4a9ad-fb3e-4dbf-b713-53b78adb6ad8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:02.384079 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38a4a9ad-fb3e-4dbf-b713-53b78adb6ad8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:02.443470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-38a4a9ad-fb3e-4dbf-b713-53b78adb6ad8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:45:02.451072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-38a4a9ad-fb3e-4dbf-b713-53b78adb6ad8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.078506 Feb 21 00:45:02.451634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 525/870] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:45:02 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:45:03.348959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fd0c7cef-68cf-4826-8267-5261c2a24e55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:03.350048 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fd0c7cef-68cf-4826-8267-5261c2a24e55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:03.360799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd0c7cef-68cf-4826-8267-5261c2a24e55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:03.361540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd0c7cef-68cf-4826-8267-5261c2a24e55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:03.362819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd0c7cef-68cf-4826-8267-5261c2a24e55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:03.363521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd0c7cef-68cf-4826-8267-5261c2a24e55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:03.502417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fd0c7cef-68cf-4826-8267-5261c2a24e55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:45:03.510494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fd0c7cef-68cf-4826-8267-5261c2a24e55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.167782 Feb 21 00:45:03.511063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 526/871] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:45:03 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:45:03.515568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6983a567-5b7d-436c-a699-65b5dd5630d9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:03.516450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6983a567-5b7d-436c-a699-65b5dd5630d9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:03.521950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6983a567-5b7d-436c-a699-65b5dd5630d9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:03.522399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6983a567-5b7d-436c-a699-65b5dd5630d9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:03.523251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6983a567-5b7d-436c-a699-65b5dd5630d9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:03.523681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6983a567-5b7d-436c-a699-65b5dd5630d9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:03.553347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6983a567-5b7d-436c-a699-65b5dd5630d9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041186 Feb 21 00:45:03.553889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 527/872] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:45:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:45:03.558213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9c7b9221-8837-4076-b545-35a1ca546363 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:03.558807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9c7b9221-8837-4076-b545-35a1ca546363 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:03.564623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c7b9221-8837-4076-b545-35a1ca546363 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:03.565036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c7b9221-8837-4076-b545-35a1ca546363 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:03.565819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c7b9221-8837-4076-b545-35a1ca546363 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:03.566245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c7b9221-8837-4076-b545-35a1ca546363 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:03.633773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9c7b9221-8837-4076-b545-35a1ca546363 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:45:03.645049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9c7b9221-8837-4076-b545-35a1ca546363 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.089873 Feb 21 00:45:03.645834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 528/873] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:45:03 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:45:03.747933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:45:03.748455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:45:03.755104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:03.755554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:03.756334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:45:03.756809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:45:12.536373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:45:12.537297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:45:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:45:26.419026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-900c2eab-8368-4287-9a3b-074f060f911b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:45:26.506281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:46:51.479701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:46:51.480913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:46:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:46:57.124258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:46:57.125327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:47:26.630711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-900c2eab-8368-4287-9a3b-074f060f911b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 202 len: 0 microversion: 2.1 time: 203.045445 Feb 21 00:47:26.631498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 346/874] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:44:03 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 203047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 00:47:26.637121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8d7d3c69-afb8-4c0f-9edc-d28f661e436a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:26.637856 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8d7d3c69-afb8-4c0f-9edc-d28f661e436a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:26.644299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c69-afb8-4c0f-9edc-d28f661e436a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.644782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c69-afb8-4c0f-9edc-d28f661e436a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.645575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c69-afb8-4c0f-9edc-d28f661e436a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.646014 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d7d3c69-afb8-4c0f-9edc-d28f661e436a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.708496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1081abd1-4bb3-44c1-b7cd-616e2751c88a) Feb 21 00:47:26.709908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1081abd1-4bb3-44c1-b7cd-616e2751c88a) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:47:26.711203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c117e6ea-ea5c-4858-8114-996464cb9fba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 143.064442 Feb 21 00:47:26.711939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 529/875] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:45:03 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 269 bytes in 143066 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:47:26.717676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-40ae5ef1-bde5-48dc-99e5-6d470639786b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:26.718716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-40ae5ef1-bde5-48dc-99e5-6d470639786b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:26.726191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40ae5ef1-bde5-48dc-99e5-6d470639786b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.726764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40ae5ef1-bde5-48dc-99e5-6d470639786b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.728249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40ae5ef1-bde5-48dc-99e5-6d470639786b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.728801 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40ae5ef1-bde5-48dc-99e5-6d470639786b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.758990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-40ae5ef1-bde5-48dc-99e5-6d470639786b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045655 Feb 21 00:47:26.759557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 530/876] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:47:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:47:26.764034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-447f069a-0d57-40ad-ad09-706e3afd1f8d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:26.764513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-447f069a-0d57-40ad-ad09-706e3afd1f8d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:26.771279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-447f069a-0d57-40ad-ad09-706e3afd1f8d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.771972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-447f069a-0d57-40ad-ad09-706e3afd1f8d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.772728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-447f069a-0d57-40ad-ad09-706e3afd1f8d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.773353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-447f069a-0d57-40ad-ad09-706e3afd1f8d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.797957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8d7d3c69-afb8-4c0f-9edc-d28f661e436a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:47:26.805869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8d7d3c69-afb8-4c0f-9edc-d28f661e436a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.172993 Feb 21 00:47:26.806781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 347/877] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:47:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:47:26.841931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-447f069a-0d57-40ad-ad09-706e3afd1f8d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:47:26.849233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-447f069a-0d57-40ad-ad09-706e3afd1f8d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.088612 Feb 21 00:47:26.849793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 531/878] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:47:26 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:47:26.853966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:26.854444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:26.859740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.860174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.861008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.861433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.876335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e2827963-d025-4264-bb4e-868a69e8ccc0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:26.877325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e2827963-d025-4264-bb4e-868a69e8ccc0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:26.883023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e2827963-d025-4264-bb4e-868a69e8ccc0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.883456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e2827963-d025-4264-bb4e-868a69e8ccc0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.884213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e2827963-d025-4264-bb4e-868a69e8ccc0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.884831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e2827963-d025-4264-bb4e-868a69e8ccc0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.914295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e2827963-d025-4264-bb4e-868a69e8ccc0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106412 Feb 21 00:47:26.914850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 348/879] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:47:26 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 00:47:26.918942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-395ad7ec-abe2-4543-bf97-e50f3d3e2dd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:26.919530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-395ad7ec-abe2-4543-bf97-e50f3d3e2dd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:26.924818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-395ad7ec-abe2-4543-bf97-e50f3d3e2dd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.925256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-395ad7ec-abe2-4543-bf97-e50f3d3e2dd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:26.926045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-395ad7ec-abe2-4543-bf97-e50f3d3e2dd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:26.926462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-395ad7ec-abe2-4543-bf97-e50f3d3e2dd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:27.058768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-395ad7ec-abe2-4543-bf97-e50f3d3e2dd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:47:27.066189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-395ad7ec-abe2-4543-bf97-e50f3d3e2dd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.150395 Feb 21 00:47:27.066732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 349/880] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:47:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:47:27.071058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-862f7d5a-438a-4d29-b79a-64aa779e816c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:27.071940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-862f7d5a-438a-4d29-b79a-64aa779e816c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:27.077751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-862f7d5a-438a-4d29-b79a-64aa779e816c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:27.078195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-862f7d5a-438a-4d29-b79a-64aa779e816c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:27.078959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-862f7d5a-438a-4d29-b79a-64aa779e816c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:27.079379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-862f7d5a-438a-4d29-b79a-64aa779e816c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:27.107708 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-862f7d5a-438a-4d29-b79a-64aa779e816c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039968 Feb 21 00:47:27.108212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 350/881] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:47:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:47:27.112216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ae7ec255-99ed-4bcd-87cb-44cb6d07de8f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:27.112823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ae7ec255-99ed-4bcd-87cb-44cb6d07de8f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:27.118194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7ec255-99ed-4bcd-87cb-44cb6d07de8f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:27.118633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7ec255-99ed-4bcd-87cb-44cb6d07de8f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:27.119381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7ec255-99ed-4bcd-87cb-44cb6d07de8f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:27.119811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7ec255-99ed-4bcd-87cb-44cb6d07de8f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:27.178353 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ae7ec255-99ed-4bcd-87cb-44cb6d07de8f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:47:27.185793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ae7ec255-99ed-4bcd-87cb-44cb6d07de8f tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.076625 Feb 21 00:47:27.186351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 351/882] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:47:27 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:47:27.190563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5cd03689-f172-4582-9be7-06031e3f4f88 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:27.191500 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5cd03689-f172-4582-9be7-06031e3f4f88 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:27.196978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cd03689-f172-4582-9be7-06031e3f4f88 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:27.197423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cd03689-f172-4582-9be7-06031e3f4f88 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:27.198171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cd03689-f172-4582-9be7-06031e3f4f88 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:27.198595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cd03689-f172-4582-9be7-06031e3f4f88 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:27.225767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5cd03689-f172-4582-9be7-06031e3f4f88 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.038480 Feb 21 00:47:27.226294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 352/883] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:47:27 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 25 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 00:47:27.230315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:47:27.230795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:47:27.236716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:27.237152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:47:27.237891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:47:27.238316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:48:15.249754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:48:15.250997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:48:19.647497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:48:19.648644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:48:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:48:32.550369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:48:32.550908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:49:26.881176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:49:26.926371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:50:11.494276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:50:11.495397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:50:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:50:14.997117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:50:14.997684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:50:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:50:17.137375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:50:17.138353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:50:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:51:27.225422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-beb21111-54a7-4f57-822b-84e24e10151a) Feb 21 00:51:27.226069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-beb21111-54a7-4f57-822b-84e24e10151a) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:51:27.226865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 240.376149 Feb 21 00:51:27.227445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:51:27.227445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:51:27 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (10.222.0.72) Feb 21 00:51:27.228339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-93da3167-a3e0-45c3-998f-cbd6b63b5340 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Unhandled error: OSError: write error Feb 21 00:51:27.228339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:51:27.228339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:51:27.228636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 532/884] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:47:26 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 240378 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:51:27.233502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-34718888-3baf-41b8-9f6c-ccb47d83cfc7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.234104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-34718888-3baf-41b8-9f6c-ccb47d83cfc7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.241187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34718888-3baf-41b8-9f6c-ccb47d83cfc7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.241687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34718888-3baf-41b8-9f6c-ccb47d83cfc7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.242454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34718888-3baf-41b8-9f6c-ccb47d83cfc7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.242853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34718888-3baf-41b8-9f6c-ccb47d83cfc7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.258239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d286466-e519-4ee9-b950-9a085b1877af) Feb 21 00:51:27.258832 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d286466-e519-4ee9-b950-9a085b1877af) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:51:27.259711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4ac60387-900f-4be3-bbde-d7e5737ac7eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 240.032578 Feb 21 00:51:27.260532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 353/885] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:47:27 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 269 bytes in 240034 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:51:27.266158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3db4b74b-77be-4c6f-b770-eaa473f6fa09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.267707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3db4b74b-77be-4c6f-b770-eaa473f6fa09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.274170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3db4b74b-77be-4c6f-b770-eaa473f6fa09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.274632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3db4b74b-77be-4c6f-b770-eaa473f6fa09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.275556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3db4b74b-77be-4c6f-b770-eaa473f6fa09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.276001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3db4b74b-77be-4c6f-b770-eaa473f6fa09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.306248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3db4b74b-77be-4c6f-b770-eaa473f6fa09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044536 Feb 21 00:51:27.306725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 354/886] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:51:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:51:27.310914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a87a1b5e-d8f6-4cb0-b9ab-9575846b15a5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.311629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a87a1b5e-d8f6-4cb0-b9ab-9575846b15a5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.317387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a87a1b5e-d8f6-4cb0-b9ab-9575846b15a5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.317986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a87a1b5e-d8f6-4cb0-b9ab-9575846b15a5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.318763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a87a1b5e-d8f6-4cb0-b9ab-9575846b15a5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.319199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a87a1b5e-d8f6-4cb0-b9ab-9575846b15a5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.379747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-34718888-3baf-41b8-9f6c-ccb47d83cfc7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:51:27.382571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a87a1b5e-d8f6-4cb0-b9ab-9575846b15a5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:51:27.387377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-34718888-3baf-41b8-9f6c-ccb47d83cfc7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.158037 Feb 21 00:51:27.387966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 533/887] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:51:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:51:27.390571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a87a1b5e-d8f6-4cb0-b9ab-9575846b15a5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.082880 Feb 21 00:51:27.391118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 355/888] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:51:27 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:51:27.392712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6060ea19-2be7-404a-84b3-bae4d1b09362 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.393674 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6060ea19-2be7-404a-84b3-bae4d1b09362 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.395565 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.396047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.399490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6060ea19-2be7-404a-84b3-bae4d1b09362 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.400006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6060ea19-2be7-404a-84b3-bae4d1b09362 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.400822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6060ea19-2be7-404a-84b3-bae4d1b09362 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.401596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6060ea19-2be7-404a-84b3-bae4d1b09362 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.401720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.402032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.402795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.403225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.430553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6060ea19-2be7-404a-84b3-bae4d1b09362 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041497 Feb 21 00:51:27.431074 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 534/889] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:51:27 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 00:51:27.435251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2de2df68-a89e-494f-8294-8f4f4f73a1c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.435850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2de2df68-a89e-494f-8294-8f4f4f73a1c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.441584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2de2df68-a89e-494f-8294-8f4f4f73a1c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.442030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2de2df68-a89e-494f-8294-8f4f4f73a1c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.442818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2de2df68-a89e-494f-8294-8f4f4f73a1c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.443423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2de2df68-a89e-494f-8294-8f4f4f73a1c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.583966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2de2df68-a89e-494f-8294-8f4f4f73a1c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:51:27.591709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2de2df68-a89e-494f-8294-8f4f4f73a1c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.159699 Feb 21 00:51:27.592281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 535/890] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:51:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:51:27.596693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6ef2a442-a104-462b-b490-f3c3f7a7593d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.597596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6ef2a442-a104-462b-b490-f3c3f7a7593d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.603354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ef2a442-a104-462b-b490-f3c3f7a7593d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.603788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ef2a442-a104-462b-b490-f3c3f7a7593d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.604598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ef2a442-a104-462b-b490-f3c3f7a7593d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.605000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ef2a442-a104-462b-b490-f3c3f7a7593d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.633015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6ef2a442-a104-462b-b490-f3c3f7a7593d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039655 Feb 21 00:51:27.633556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 536/891] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:51:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:51:27.637526 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e44cc1fc-953f-49ab-97c7-7de64895f8d9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.638109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e44cc1fc-953f-49ab-97c7-7de64895f8d9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.643687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e44cc1fc-953f-49ab-97c7-7de64895f8d9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.644125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e44cc1fc-953f-49ab-97c7-7de64895f8d9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.645003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e44cc1fc-953f-49ab-97c7-7de64895f8d9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.645329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e44cc1fc-953f-49ab-97c7-7de64895f8d9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.707042 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e44cc1fc-953f-49ab-97c7-7de64895f8d9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:51:27.714548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e44cc1fc-953f-49ab-97c7-7de64895f8d9 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.080127 Feb 21 00:51:27.715092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 537/892] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:51:27 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:51:27.719449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-826003ed-535c-4e13-92e0-35d86e408302 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.720334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-826003ed-535c-4e13-92e0-35d86e408302 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.725703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-826003ed-535c-4e13-92e0-35d86e408302 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.726134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-826003ed-535c-4e13-92e0-35d86e408302 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.726893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-826003ed-535c-4e13-92e0-35d86e408302 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.727317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-826003ed-535c-4e13-92e0-35d86e408302 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.756240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-826003ed-535c-4e13-92e0-35d86e408302 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040129 Feb 21 00:51:27.756817 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 538/893] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:51:27 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 00:51:27.761104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:51:27.761584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:51:27.766989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.767426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:27.768181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:51:27.768640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:51:35.262843 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:51:35.263926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:51:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:51:39.661324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:51:39.662242 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:51:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:51:52.559933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:51:52.560448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:53:27.468115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:53:27.555667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:53:31.507301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:53:31.508517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:53:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:53:35.006754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:53:35.007503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:53:37.150459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:53:37.151356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:53:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:54:55.276015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:54:55.276977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:54:59.676783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:54:59.677985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:54:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:55:12.571257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:55:12.571735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:55:27.608124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb76e85c-cf62-4383-b8ae-a83c09710ced) Feb 21 00:55:27.609497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb76e85c-cf62-4383-b8ae-a83c09710ced) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:55:27.610382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 240.218161 Feb 21 00:55:27.611046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:55:27.611046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:55:27 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (10.222.0.72) Feb 21 00:55:27.611775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-ba6a9123-0f22-4e91-9e46-4e831b6fdc5b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Unhandled error: OSError: write error Feb 21 00:55:27.611775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:55:27.611775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:55:27.612109 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 356/894] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:51:27 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 240220 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:55:27.642297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e658754-e008-44f1-ac9f-8315fd931e2e) Feb 21 00:55:27.643017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e658754-e008-44f1-ac9f-8315fd931e2e) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:55:27.644112 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 239.886343 Feb 21 00:55:27.644782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:55:27.644782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:27 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (10.222.0.72) Feb 21 00:55:27.645584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-5b898cd5-94f3-4e04-9daf-94df6497b1ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Unhandled error: OSError: write error Feb 21 00:55:27.645584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:55:27.645584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:55:27.645584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 539/895] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:51:27 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 239888 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:55:27.650669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5c5bc871-b223-4d02-88d1-606b5f54ce54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:55:27.652180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5c5bc871-b223-4d02-88d1-606b5f54ce54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:55:27.658690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5c5bc871-b223-4d02-88d1-606b5f54ce54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.659254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5c5bc871-b223-4d02-88d1-606b5f54ce54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.659883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5c5bc871-b223-4d02-88d1-606b5f54ce54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.660459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5c5bc871-b223-4d02-88d1-606b5f54ce54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.693491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5c5bc871-b223-4d02-88d1-606b5f54ce54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047007 Feb 21 00:55:27.694177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:55:27.694177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:27 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (10.222.0.72) Feb 21 00:55:27.694779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-5c5bc871-b223-4d02-88d1-606b5f54ce54 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Unhandled error: OSError: write error Feb 21 00:55:27.694779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:55:27.694779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:55:27.695037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 540/896] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:55:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:55:27.699050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:55:27.699798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:55:27.705408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.705742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.706509 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.706926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.738508 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:55:27.739216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:55:27.746140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.746702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.747616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.748150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.771062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:55:27.778734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1225 microversion: 2.1 time: 0.082910 Feb 21 00:55:27.779369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (ip 10.222.0.72) !!! Feb 21 00:55:27.779369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:27 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (10.222.0.72) Feb 21 00:55:27.780088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-79e63618-ae83-45d9-9cdf-e62e472e4e3d tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Unhandled error: OSError: write error Feb 21 00:55:27.780088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:55:27.780088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:55:27.780366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 541/897] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:55:27 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:55:27.885063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:55:27.892943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1569 microversion: 2.1 time: 0.280124 Feb 21 00:55:27.893448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (ip 10.222.0.72) !!! Feb 21 00:55:27.893448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:55:27 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (10.222.0.72) Feb 21 00:55:27.894033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-f174ec4b-7bfa-4078-af42-8fd4648d331b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Unhandled error: OSError: write error Feb 21 00:55:27.894033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:55:27.894033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:55:27.894324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 357/898] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:55:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:55:27.896375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4625bbf2-089f-4f30-b99a-e49f712c2c9d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:55:27.897392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4625bbf2-089f-4f30-b99a-e49f712c2c9d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:55:27.903572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4625bbf2-089f-4f30-b99a-e49f712c2c9d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.904020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4625bbf2-089f-4f30-b99a-e49f712c2c9d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.904828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4625bbf2-089f-4f30-b99a-e49f712c2c9d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.905256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4625bbf2-089f-4f30-b99a-e49f712c2c9d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.934630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4625bbf2-089f-4f30-b99a-e49f712c2c9d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153102 Feb 21 00:55:27.935140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:55:27.935140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:55:27 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (10.222.0.72) Feb 21 00:55:27.935724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-4625bbf2-089f-4f30-b99a-e49f712c2c9d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Unhandled error: OSError: write error Feb 21 00:55:27.935724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:55:27.935724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:55:27.936021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 542/899] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:55:27 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:55:27.940144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:55:27.940669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:55:27.946300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.946751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:27.947551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:27.947967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:28.027905 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:55:28.028414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:55:28.034914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:28.035285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:55:28.036052 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:55:28.036506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:56:51.520190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:56:51.521509 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:56:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:56:55.019747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:56:55.020701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:56:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (ip 10.222.0.72) !!! Feb 21 00:56:57.163804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:56:57.164477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:57:27.949506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:57:27.988612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:58:15.289715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:58:15.290991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:58:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (ip 10.222.0.72) !!! Feb 21 00:58:19.690174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:58:19.691077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:58:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (ip 10.222.0.72) !!! Feb 21 00:58:32.580765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 00:58:32.581522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:59:13.706984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00726d7c-e536-4d12-b226-f7294f201cae) Feb 21 00:59:13.707962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00726d7c-e536-4d12-b226-f7294f201cae) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:13.708600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 225.771837 Feb 21 00:59:13.709182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:59:13.709351 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (10.222.0.72) Feb 21 00:59:13.709858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-7c143050-3b2b-4e32-bc2d-0b5d20b47ef9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Unhandled error: OSError: write error Feb 21 00:59:13.709858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:13.709858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:13.710181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 543/900] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:55:27 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 225774 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:13.716810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:13.717412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:13.723977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.724446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.725228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.725653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.808787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 202 len: 0 microversion: 2.1 time: 225.913339 Feb 21 00:59:13.809530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (ip 10.222.0.72) !!! Feb 21 00:59:13.809530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:13 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (10.222.0.72) Feb 21 00:59:13.810511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-359598fb-6bb4-4168-8ad9-9ba090cfd9ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Unhandled error: OSError: write error Feb 21 00:59:13.810511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:13.810511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:13.810970 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 358/901] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:55:27 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 0 bytes in 225916 msecs (HTTP/1.1 202) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:13.817978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4dfdd69e-f058-4600-8342-f536c77887e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:13.819296 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4dfdd69e-f058-4600-8342-f536c77887e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:13.827007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4dfdd69e-f058-4600-8342-f536c77887e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.827881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4dfdd69e-f058-4600-8342-f536c77887e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.829271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4dfdd69e-f058-4600-8342-f536c77887e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.829951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4dfdd69e-f058-4600-8342-f536c77887e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.865762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4dfdd69e-f058-4600-8342-f536c77887e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052780 Feb 21 00:59:13.866801 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:13.866983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (10.222.0.72) Feb 21 00:59:13.867728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-4dfdd69e-f058-4600-8342-f536c77887e2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Unhandled error: OSError: write error Feb 21 00:59:13.867728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:13.867728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:13.868047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 359/902] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:59:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:13.871898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:13.872173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:13.872821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:13.879842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.880540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1563 microversion: 2.1 time: 0.169593 Feb 21 00:59:13.880680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.881365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.881486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (ip 10.222.0.72) !!! Feb 21 00:59:13.881640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (10.222.0.72) Feb 21 00:59:13.881788 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.882489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-c7535151-11d1-4671-8f90-ba8c6a5a0033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Unhandled error: OSError: write error Feb 21 00:59:13.882489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:13.882489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:13.883005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 544/903] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:13.890101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-55b8bb53-4e7c-4ad0-b59b-720645329969 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:13.891098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-55b8bb53-4e7c-4ad0-b59b-720645329969 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:13.897757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55b8bb53-4e7c-4ad0-b59b-720645329969 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.898431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55b8bb53-4e7c-4ad0-b59b-720645329969 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.899373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55b8bb53-4e7c-4ad0-b59b-720645329969 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.901085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55b8bb53-4e7c-4ad0-b59b-720645329969 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.913491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.913939 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.914379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lazy-loading 'fault' on Instance uuid eaf1e55d-f089-4700-84ba-c7daee664ac5 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:13.948965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-55b8bb53-4e7c-4ad0-b59b-720645329969 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064622 Feb 21 00:59:13.949498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:13.949498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (10.222.0.72) Feb 21 00:59:13.950500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-55b8bb53-4e7c-4ad0-b59b-720645329969 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Unhandled error: OSError: write error Feb 21 00:59:13.950500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:13.950500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:13.950500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 545/904] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:59:13 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:13.955555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:13.956050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:13.962811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.963794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.965488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.965920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.968837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01450ffdb03d4d51b6c96024085b1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d143cea723743ada5bdde1be0b26db4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:13.977865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 200 len: 1230 microversion: 2.1 time: 0.109010 Feb 21 00:59:13.978387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (ip 10.222.0.72) !!! Feb 21 00:59:13.978387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:13 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (10.222.0.72) Feb 21 00:59:13.978995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-be71e8be-24b2-4388-bdd9-b4208cb650f6 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Unhandled error: OSError: write error Feb 21 00:59:13.978995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:13.978995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:13.979230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 360/905] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:13 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:13.983547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:13.984038 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:13.989824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.990273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:13.991057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:13.991485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.058144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:14.104949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:14.138796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a63979f8-17d6-4cd1-aa33-61b339a49968) Feb 21 00:59:14.139433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a63979f8-17d6-4cd1-aa33-61b339a49968) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.140282 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.188807 Feb 21 00:59:14.140895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (ip 10.222.0.72) !!! Feb 21 00:59:14.140895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (10.222.0.72) Feb 21 00:59:14.141572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-6dbee21b-1816-41e1-8053-92e0812d1187 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Unhandled error: OSError: write error Feb 21 00:59:14.141572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:14.141572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:14.141572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 546/906] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:13 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 0 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.145980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.146585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.152707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.153206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.153911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.154657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.170373 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-39ddcaaa-d7d5-4e30-87d2-5a2d58931589) Feb 21 00:59:14.170981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-39ddcaaa-d7d5-4e30-87d2-5a2d58931589) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.171845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.191826 Feb 21 00:59:14.172381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:59:14.172381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (10.222.0.72) Feb 21 00:59:14.173005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-453e1b60-ffc6-4b9d-9bb8-c7def334a6aa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Unhandled error: OSError: write error Feb 21 00:59:14.173005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.173005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.173333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 361/907] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:13 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.177551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c8f23620-0809-4002-9186-f5fabe76a056 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.178464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c8f23620-0809-4002-9186-f5fabe76a056 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.184223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c8f23620-0809-4002-9186-f5fabe76a056 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.184701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c8f23620-0809-4002-9186-f5fabe76a056 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.185467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c8f23620-0809-4002-9186-f5fabe76a056 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.185896 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c8f23620-0809-4002-9186-f5fabe76a056 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.214907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c8f23620-0809-4002-9186-f5fabe76a056 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040791 Feb 21 00:59:14.215410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:14.215410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (10.222.0.72) Feb 21 00:59:14.215983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-c8f23620-0809-4002-9186-f5fabe76a056 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Unhandled error: OSError: write error Feb 21 00:59:14.215983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.215983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.216271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 362/908] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.220375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.221004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.226439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.226864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.227635 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.228082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.241292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:14.241882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.242696 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.025705 Feb 21 00:59:14.243187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (ip 10.222.0.72) !!! Feb 21 00:59:14.243187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (10.222.0.72) Feb 21 00:59:14.243746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-18d7cf4d-4806-4297-94ca-01f746aa7df2 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Unhandled error: OSError: write error Feb 21 00:59:14.243746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.243746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.244012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 363/909] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.248158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d78ea829-1a94-40cb-b7b2-d73d59b1d314 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.249079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d78ea829-1a94-40cb-b7b2-d73d59b1d314 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.254632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d78ea829-1a94-40cb-b7b2-d73d59b1d314 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.255075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d78ea829-1a94-40cb-b7b2-d73d59b1d314 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.255845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d78ea829-1a94-40cb-b7b2-d73d59b1d314 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.256273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d78ea829-1a94-40cb-b7b2-d73d59b1d314 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.284620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d78ea829-1a94-40cb-b7b2-d73d59b1d314 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039713 Feb 21 00:59:14.285125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:14.285125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (10.222.0.72) Feb 21 00:59:14.285724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-d78ea829-1a94-40cb-b7b2-d73d59b1d314 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Unhandled error: OSError: write error Feb 21 00:59:14.285724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.285724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.286027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 364/910] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.289748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:14.290260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.290764 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.296813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.297315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.298143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.298521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.298637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1563 microversion: 2.1 time: 0.156031 Feb 21 00:59:14.299136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (ip 10.222.0.72) !!! Feb 21 00:59:14.299136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (10.222.0.72) Feb 21 00:59:14.299693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-3822853d-38e2-4e3a-8905-bea5ee2e01b8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Unhandled error: OSError: write error Feb 21 00:59:14.299693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:14.299693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:14.299989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 547/911] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.304404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.304908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.310636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.311089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.311867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.312294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.376114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:14.414100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:14.439863 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-31dc6f60-fcab-4dea-a821-733e51317b69) Feb 21 00:59:14.440522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-31dc6f60-fcab-4dea-a821-733e51317b69) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.441365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.154639 Feb 21 00:59:14.441886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (ip 10.222.0.72) !!! Feb 21 00:59:14.441886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (10.222.0.72) Feb 21 00:59:14.442547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-38f100c5-fb0f-4541-a195-c2b03e286934 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Unhandled error: OSError: write error Feb 21 00:59:14.442547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.442547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.442825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 365/912] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:14 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 0 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.446986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.447611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.453807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.454276 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.455046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.455477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.472007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb096ab6-4590-4763-be0b-74ed875dbb2c) Feb 21 00:59:14.472658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb096ab6-4590-4763-be0b-74ed875dbb2c) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.473536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.172621 Feb 21 00:59:14.474054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:59:14.474054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (10.222.0.72) Feb 21 00:59:14.474638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-008cb39d-9543-49c2-908f-ea1493c1dcba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Unhandled error: OSError: write error Feb 21 00:59:14.474638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:14.474638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:14.474916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 548/913] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:14 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.479316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-706d381b-f1a8-4907-85d9-926f00502af5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.480311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-706d381b-f1a8-4907-85d9-926f00502af5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.486534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-706d381b-f1a8-4907-85d9-926f00502af5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.486982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-706d381b-f1a8-4907-85d9-926f00502af5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.487764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-706d381b-f1a8-4907-85d9-926f00502af5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.488199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-706d381b-f1a8-4907-85d9-926f00502af5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.518473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-706d381b-f1a8-4907-85d9-926f00502af5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042643 Feb 21 00:59:14.518981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:14.518981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (10.222.0.72) Feb 21 00:59:14.519544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-706d381b-f1a8-4907-85d9-926f00502af5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Unhandled error: OSError: write error Feb 21 00:59:14.519544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:14.519544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:14.519994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 549/914] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.524439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.525063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.531460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.531958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.532831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.533298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.546895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:14.547545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.548608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.027533 Feb 21 00:59:14.549068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (ip 10.222.0.72) !!! Feb 21 00:59:14.549068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (10.222.0.72) Feb 21 00:59:14.549637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-84d7ed69-ddcd-4fbe-8ba8-7ffe889baab1 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Unhandled error: OSError: write error Feb 21 00:59:14.549637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:14.549637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:14.549919 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 550/915] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 0 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.554600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-caeeefc6-a69d-4df1-846b-f129998b9c6a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.555525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-caeeefc6-a69d-4df1-846b-f129998b9c6a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.561520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caeeefc6-a69d-4df1-846b-f129998b9c6a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.561965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caeeefc6-a69d-4df1-846b-f129998b9c6a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.562778 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caeeefc6-a69d-4df1-846b-f129998b9c6a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.563274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caeeefc6-a69d-4df1-846b-f129998b9c6a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.592697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-caeeefc6-a69d-4df1-846b-f129998b9c6a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041904 Feb 21 00:59:14.593198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:14.593198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (10.222.0.72) Feb 21 00:59:14.593777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-caeeefc6-a69d-4df1-846b-f129998b9c6a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Unhandled error: OSError: write error Feb 21 00:59:14.593777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:14.593777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:14.594078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 551/916] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.597936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:14.598620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.599116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.604896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.605344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.605854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1563 microversion: 2.1 time: 0.162138 Feb 21 00:59:14.606130 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.606494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (ip 10.222.0.72) !!! Feb 21 00:59:14.606494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (10.222.0.72) Feb 21 00:59:14.606727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.607233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-e59e6e2a-d867-40be-af75-beb34e211d22 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Unhandled error: OSError: write error Feb 21 00:59:14.607233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.607233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.607551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 366/917] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.611843 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.612427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.618015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.618531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.619366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.619873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.684170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:14.731926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:14.757764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8089e87-e6ff-46b6-97e0-e664c2177cac) Feb 21 00:59:14.758498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8089e87-e6ff-46b6-97e0-e664c2177cac) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.759346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.164529 Feb 21 00:59:14.759890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (ip 10.222.0.72) !!! Feb 21 00:59:14.759890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (10.222.0.72) Feb 21 00:59:14.760476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-7bb7a011-5911-46a1-9cbd-c8d3c2377650 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Unhandled error: OSError: write error Feb 21 00:59:14.760476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:14.760476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:14.760732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 552/918] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:14 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 0 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.764955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.765551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.771498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.771945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.772836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.773266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.790064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1baf4703-b532-49a8-95f3-6ac982b74360) Feb 21 00:59:14.790733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1baf4703-b532-49a8-95f3-6ac982b74360) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.791575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.183177 Feb 21 00:59:14.792079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:59:14.792079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (10.222.0.72) Feb 21 00:59:14.792677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-499ae68e-dd8e-4359-8c83-6b2f983eee65 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Unhandled error: OSError: write error Feb 21 00:59:14.792677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.792677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.792921 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 367/919] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:14 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.797230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d49ad5dc-d9da-4252-9272-34b9959f3e21 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.798163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d49ad5dc-d9da-4252-9272-34b9959f3e21 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.804177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d49ad5dc-d9da-4252-9272-34b9959f3e21 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.804596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d49ad5dc-d9da-4252-9272-34b9959f3e21 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.805357 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d49ad5dc-d9da-4252-9272-34b9959f3e21 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.805795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d49ad5dc-d9da-4252-9272-34b9959f3e21 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.835396 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d49ad5dc-d9da-4252-9272-34b9959f3e21 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041610 Feb 21 00:59:14.836117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:14.836117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (10.222.0.72) Feb 21 00:59:14.836491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-d49ad5dc-d9da-4252-9272-34b9959f3e21 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Unhandled error: OSError: write error Feb 21 00:59:14.836491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.836491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.836765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 368/920] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.840776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.841367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.846915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.847359 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.848125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.848581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.861333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:14.861916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:14.862735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.025241 Feb 21 00:59:14.863207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (ip 10.222.0.72) !!! Feb 21 00:59:14.863207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (10.222.0.72) Feb 21 00:59:14.863775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-3cc2d31d-e7fd-4b12-a177-5f66796f483a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Unhandled error: OSError: write error Feb 21 00:59:14.863775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.863775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.864046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 369/921] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.868169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-539fd118-c0f8-4a27-9cce-83f0446aa4fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.869041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-539fd118-c0f8-4a27-9cce-83f0446aa4fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.874691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-539fd118-c0f8-4a27-9cce-83f0446aa4fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.875131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-539fd118-c0f8-4a27-9cce-83f0446aa4fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.875954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-539fd118-c0f8-4a27-9cce-83f0446aa4fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.876377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-539fd118-c0f8-4a27-9cce-83f0446aa4fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.904578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-539fd118-c0f8-4a27-9cce-83f0446aa4fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039400 Feb 21 00:59:14.905090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:14.905090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments (10.222.0.72) Feb 21 00:59:14.905664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-539fd118-c0f8-4a27-9cce-83f0446aa4fd tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Unhandled error: OSError: write error Feb 21 00:59:14.905664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:14.905664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:14.905976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 370/922] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.909384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:14.910145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.910653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.916064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.916536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.916832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1563 microversion: 2.1 time: 0.155173 Feb 21 00:59:14.917300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.917422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (ip 10.222.0.72) !!! Feb 21 00:59:14.917422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:14 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (10.222.0.72) Feb 21 00:59:14.917720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.917908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-730fae5a-32d6-41cd-bf07-1a5674e061a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Unhandled error: OSError: write error Feb 21 00:59:14.917908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:14.917908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:14.918163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 553/923] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:14.922443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:14.922935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:14.928368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.928840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:14.929611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:14.930036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.025624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:15.065021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:15.090140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a888125-9b7b-4baa-9cfe-4baa0f5798d3) Feb 21 00:59:15.090747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a888125-9b7b-4baa-9cfe-4baa0f5798d3) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.091590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.184910 Feb 21 00:59:15.092094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (ip 10.222.0.72) !!! Feb 21 00:59:15.092094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:15 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 (10.222.0.72) Feb 21 00:59:15.092694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-1c54c793-6558-4bb7-aae8-91d8ac2905ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Unhandled error: OSError: write error Feb 21 00:59:15.092694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:15.092694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:15.092949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 371/924] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:14 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 0 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:15.097188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.097800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.103810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.104254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.105071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.105493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.125685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da96bb31-529a-477c-9d3c-85ce139fd2be) Feb 21 00:59:15.126299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-da96bb31-529a-477c-9d3c-85ce139fd2be) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.127140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.208245 Feb 21 00:59:15.127648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (ip 10.222.0.72) !!! Feb 21 00:59:15.127648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:15 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 (10.222.0.72) Feb 21 00:59:15.128216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-8d183beb-6244-466c-9815-4bc1cee2e4ae tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Unhandled error: OSError: write error Feb 21 00:59:15.128216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:15.128216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:15.128507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 554/925] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:14 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 0 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:15.132800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a2bfc5b0-f09a-44f4-b500-37d632100684 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.133739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a2bfc5b0-f09a-44f4-b500-37d632100684 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.139593 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2bfc5b0-f09a-44f4-b500-37d632100684 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.140034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2bfc5b0-f09a-44f4-b500-37d632100684 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.140835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2bfc5b0-f09a-44f4-b500-37d632100684 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.141307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2bfc5b0-f09a-44f4-b500-37d632100684 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.170769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a2bfc5b0-f09a-44f4-b500-37d632100684 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041392 Feb 21 00:59:15.171280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (ip 10.222.0.72) !!! Feb 21 00:59:15.171280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:15 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments (10.222.0.72) Feb 21 00:59:15.172123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-a2bfc5b0-f09a-44f4-b500-37d632100684 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Unhandled error: OSError: write error Feb 21 00:59:15.172123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:15.172123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:15.172123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 555/926] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:59:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:15.176228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.176856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.182935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.183377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.184149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.184700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.199620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:15.200215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.201052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.028143 Feb 21 00:59:15.201569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (ip 10.222.0.72) !!! Feb 21 00:59:15.201569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 00:59:15 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 (10.222.0.72) Feb 21 00:59:15.202128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: CRITICAL nova [None req-2f9bd497-9f2b-46dc-b855-49d0d671419a tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Unhandled error: OSError: write error Feb 21 00:59:15.202128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova OSError: write error Feb 21 00:59:15.202128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR nova Feb 21 00:59:15.202363 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 556/927] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:15 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 0 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:15.206603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a615547a-d35c-45fc-bf94-7d304cbbcc07 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.207499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a615547a-d35c-45fc-bf94-7d304cbbcc07 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.213019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a615547a-d35c-45fc-bf94-7d304cbbcc07 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.213459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a615547a-d35c-45fc-bf94-7d304cbbcc07 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.214272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a615547a-d35c-45fc-bf94-7d304cbbcc07 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.214715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a615547a-d35c-45fc-bf94-7d304cbbcc07 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.240995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:15.242831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a615547a-d35c-45fc-bf94-7d304cbbcc07 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039587 Feb 21 00:59:15.243396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 557/928] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:59:15 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 00:59:15.247723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.248208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.248554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1563 microversion: 2.1 time: 0.154797 Feb 21 00:59:15.249067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (ip 10.222.0.72) !!! Feb 21 00:59:15.249067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 00:59:15 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f (10.222.0.72) Feb 21 00:59:15.249655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: CRITICAL nova [None req-23260019-3cf5-446f-afda-cbd10cdd537e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Unhandled error: OSError: write error Feb 21 00:59:15.249655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova OSError: write error Feb 21 00:59:15.249655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR nova Feb 21 00:59:15.249961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 372/929] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Feb 21 00:59:15.253796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.254090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.254227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.254561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.254997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.255422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.260072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.260553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.261323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.261774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.333211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:15.374463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:15.399627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bbdfd40-63fc-48ad-9720-deab180d1c8b) Feb 21 00:59:15.400233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bbdfd40-63fc-48ad-9720-deab180d1c8b) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.401107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6da0cd1d-188a-43a7-9262-7c768d1039f3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.156820 Feb 21 00:59:15.401676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 558/930] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 269 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:15.406222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-719e0deb-b08b-4c0e-9fb5-556d8a2f0dfa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.406910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-719e0deb-b08b-4c0e-9fb5-556d8a2f0dfa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.413104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-719e0deb-b08b-4c0e-9fb5-556d8a2f0dfa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.413576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-719e0deb-b08b-4c0e-9fb5-556d8a2f0dfa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.414334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-719e0deb-b08b-4c0e-9fb5-556d8a2f0dfa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.414764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-719e0deb-b08b-4c0e-9fb5-556d8a2f0dfa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.431634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-05f12881-fd94-4c9e-bf37-70ac6f36a413) Feb 21 00:59:15.432231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-05f12881-fd94-4c9e-bf37-70ac6f36a413) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.433105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-022d3729-5a35-418a-811b-5521bc3860c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.182483 Feb 21 00:59:15.433654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 373/931] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 269 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:15.438193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-271988a8-e057-4638-863e-1b9c6f0a3143 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.439197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-271988a8-e057-4638-863e-1b9c6f0a3143 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.445180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-271988a8-e057-4638-863e-1b9c6f0a3143 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.445620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-271988a8-e057-4638-863e-1b9c6f0a3143 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.446393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-271988a8-e057-4638-863e-1b9c6f0a3143 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.446820 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-271988a8-e057-4638-863e-1b9c6f0a3143 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.477118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-271988a8-e057-4638-863e-1b9c6f0a3143 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042381 Feb 21 00:59:15.477672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 374/932] 10.222.0.72 () {60 vars in 1342 bytes} [Mon Feb 21 00:59:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 00:59:15.481830 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.482435 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.487888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.488546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.489985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.490425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.503175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:15.503726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.504607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-621d742e-b9cf-4526-adee-fcd20ba42280 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.026016 Feb 21 00:59:15.505367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 375/933] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:15 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:59:15.509423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2a1d106f-5bf6-4c19-9575-5f401ee513a3 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.510350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2a1d106f-5bf6-4c19-9575-5f401ee513a3 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.515959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2a1d106f-5bf6-4c19-9575-5f401ee513a3 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.516430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2a1d106f-5bf6-4c19-9575-5f401ee513a3 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.517214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2a1d106f-5bf6-4c19-9575-5f401ee513a3 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.517641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2a1d106f-5bf6-4c19-9575-5f401ee513a3 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.546758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2a1d106f-5bf6-4c19-9575-5f401ee513a3 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040635 Feb 21 00:59:15.547340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 376/934] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 00:59:15 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 00:59:15.551721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.552211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.556077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-719e0deb-b08b-4c0e-9fb5-556d8a2f0dfa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:15.557987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.558351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.559147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.559615 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.565609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-719e0deb-b08b-4c0e-9fb5-556d8a2f0dfa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1563 microversion: 2.1 time: 0.162992 Feb 21 00:59:15.566198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 559/935] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:15.570679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.571298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.577139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.577582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.578353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.578815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.635569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:15.673627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:15.699419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c780c80d-f9a2-4840-a071-eedc1e425a37) Feb 21 00:59:15.700059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c780c80d-f9a2-4840-a071-eedc1e425a37) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.700967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-063b7827-3ba9-4143-878d-862a74d5f3f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.152710 Feb 21 00:59:15.701518 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 377/936] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 269 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:15.705912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.706512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.712377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.712854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.713622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.714055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.727389 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:15.728178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.729067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-17f6232f-f615-4b7b-9577-33933ffe1d7c tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.026683 Feb 21 00:59:15.729633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 378/937] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:59:15.731083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d89f4d8d-7705-483a-a5ce-d3e99e7bdf32) Feb 21 00:59:15.731720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d89f4d8d-7705-483a-a5ce-d3e99e7bdf32) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.732735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e42a9c83-15a3-4bf6-88a2-510e1fa7a017 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.165439 Feb 21 00:59:15.733349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 560/938] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:15.734195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7d38277d-c266-4472-84e4-8cf280a68a2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.734683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7d38277d-c266-4472-84e4-8cf280a68a2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.740579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7d38277d-c266-4472-84e4-8cf280a68a2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.741024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7d38277d-c266-4472-84e4-8cf280a68a2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.741787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7d38277d-c266-4472-84e4-8cf280a68a2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.742216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7d38277d-c266-4472-84e4-8cf280a68a2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.766387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7d38277d-c266-4472-84e4-8cf280a68a2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:59:15.789729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-c5e3cd65-9a30-4707-9169-448f95d9d543 req-ad149c86-17a7-42fe-b35b-cf83c6a69d80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d201f02-8582-4720-942e-8d62400e176f", "tag": "bf929627-3fbe-4a88-9f95-bbe9870fa556"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:59:15.791271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:59:15.791271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:59:15.798669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-c5e3cd65-9a30-4707-9169-448f95d9d543 req-ad149c86-17a7-42fe-b35b-cf83c6a69d80 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.799103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-c5e3cd65-9a30-4707-9169-448f95d9d543 req-ad149c86-17a7-42fe-b35b-cf83c6a69d80 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.810368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-c5e3cd65-9a30-4707-9169-448f95d9d543 req-ad149c86-17a7-42fe-b35b-cf83c6a69d80 service nova] Creating event network-changed:bf929627-3fbe-4a88-9f95-bbe9870fa556 for instance 9d201f02-8582-4720-942e-8d62400e176f on hv-cinder-81322 Feb 21 00:59:15.816679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-c5e3cd65-9a30-4707-9169-448f95d9d543 req-ad149c86-17a7-42fe-b35b-cf83c6a69d80 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081935 Feb 21 00:59:15.817294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 561/939] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:59:15.822578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.823144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.829791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.830237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.831021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.831448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.851264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7d38277d-c266-4472-84e4-8cf280a68a2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 204 len: 0 microversion: 2.1 time: 0.119837 Feb 21 00:59:15.851931 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 379/940] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:59:15.860748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:15.861403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:15.867736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.868174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.869002 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:15.869434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:15.917984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:15.958462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:15.992839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ef23dc0-ed06-4108-be41-0f5457271fa8) Feb 21 00:59:15.993443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3ef23dc0-ed06-4108-be41-0f5457271fa8) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:15.994284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b8f4a8a5-8f91-48fe-bc9f-b55e5a860473 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.175863 Feb 21 00:59:15.994831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 562/941] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 269 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:15.999424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.000165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.006020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.006463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.007228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.007651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.022035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:16.022659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.023678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9bf39312-c50f-41e8-a9ad-025e4fb2edb8 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.027819 Feb 21 00:59:16.024748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 563/942] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:59:16.029563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.030178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-399ef186-99b7-4118-b37e-74e19171ed7a) Feb 21 00:59:16.030425 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.031206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-399ef186-99b7-4118-b37e-74e19171ed7a) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.034119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-96b5df8f-496f-48fc-aa94-bd50e84332ee tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.180559 Feb 21 00:59:16.035105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 380/943] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:15 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 269 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:16.037598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.038089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.039056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.039491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.045250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.046136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.054302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.055705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.056860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.057480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.067394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Going to try to terminate instance {{(pid=123098) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:59:16.128150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.compute.api [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Instance is already in deleting state, ignoring this request Feb 21 00:59:16.129028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-aff4874c-fe98-412b-aa41-97f4b318d10f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 204 len: 0 microversion: 2.1 time: 0.103164 Feb 21 00:59:16.129820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 564/944] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:59:16.134741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.135452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.144521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.145235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.146094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.146521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.161869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:16.234883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:16.261811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-25256046-f557-4f8e-b2a2-9b93b30ba506) Feb 21 00:59:16.262415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-25256046-f557-4f8e-b2a2-9b93b30ba506) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.263512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5e023716-439d-4cd7-bbd2-5870eee96550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.226864 Feb 21 00:59:16.263798 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 381/945] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 269 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:16.268244 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.268762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.274683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.275131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.275923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.276348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.290211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:16.290811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.292191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b4b17dd5-87f6-4f07-bd48-c97bee05c8be tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.026894 Feb 21 00:59:16.292191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 382/946] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:59:16.296858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.297098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.303502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.303919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.304792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.305626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.314909 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3186d179-e28e-4279-af35-0522ccfc57b6) Feb 21 00:59:16.316895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3186d179-e28e-4279-af35-0522ccfc57b6) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.318055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-129e3fb7-ef02-4013-a947-ff3c10635c88 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.187115 Feb 21 00:59:16.319172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 565/947] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 269 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:16.324015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.325854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.330739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:59:16.334176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.334686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.336561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.337060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.382484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.compute.api [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Instance is already in deleting state, ignoring this request Feb 21 00:59:16.383369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-79509e9a-5c2f-42b5-8963-015cb729f09c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 204 len: 0 microversion: 2.1 time: 0.090165 Feb 21 00:59:16.384047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 383/948] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:59:16.389829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.390320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.398113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.398623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.399540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.400036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.427407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:16.482074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lazy-loading 'services' on Instance uuid 1e018349-6a79-41ca-89e4-86d1bf355cd0 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:16.510113 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d5e071a1-9731-4d88-a973-8b719204306c) Feb 21 00:59:16.510764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d5e071a1-9731-4d88-a973-8b719204306c) {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.511644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8107e9e6-697d-41a7-8b7d-6e7a62528e87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09" status: 400 len: 269 microversion: 2.1 time: 0.191326 Feb 21 00:59:16.516757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 566/949] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c/os-volume_attachments/aeaff174-0ced-476f-a5b2-f4bcf3867e09 => generated 269 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:16.517357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.518045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.524986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.525481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.526279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.527241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.543081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:16.543688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.544553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ad8cbd49-e111-4087-815a-fc6bc6e17c48 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.031069 Feb 21 00:59:16.545366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 567/950] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:59:16.550345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.550871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.554688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1fe3ee3e-fea2-43f6-92e9-d19e14f75646) Feb 21 00:59:16.555286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1fe3ee3e-fea2-43f6-92e9-d19e14f75646) {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.557135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.557469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0e7840f4-785f-43b3-aaec-09378312e2c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771" status: 400 len: 269 microversion: 2.1 time: 0.172300 Feb 21 00:59:16.557580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.558359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.558790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.562110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 384/951] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0/os-volume_attachments/c134cbee-c21d-4e8c-bf33-9f5afd7fe771 => generated 269 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 00:59:16.566858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1a13d84d-ce3e-42dd-8a05-ec587ee3db3f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.567472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1a13d84d-ce3e-42dd-8a05-ec587ee3db3f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.574869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a13d84d-ce3e-42dd-8a05-ec587ee3db3f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.574869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a13d84d-ce3e-42dd-8a05-ec587ee3db3f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.575487 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a13d84d-ce3e-42dd-8a05-ec587ee3db3f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.575911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a13d84d-ce3e-42dd-8a05-ec587ee3db3f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.586153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Going to try to terminate instance {{(pid=123098) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:59:16.618551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1a13d84d-ce3e-42dd-8a05-ec587ee3db3f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 00:59:16.651986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.compute.api [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Instance is already in deleting state, ignoring this request Feb 21 00:59:16.652598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d6bef59e-e296-435b-817e-a1a9e6b34c86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 204 len: 0 microversion: 2.1 time: 0.106241 Feb 21 00:59:16.653489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 568/952] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:59:16.658746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.659354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] [instance: eaf1e55d-f089-4700-84ba-c7daee664ac5] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.667788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.668323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.669184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.669616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.701154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] HTTP exception thrown: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. Feb 21 00:59:16.702138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Returning 404 to user: Instance eaf1e55d-f089-4700-84ba-c7daee664ac5 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:16.703198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ffde77ce-f7b7-4382-8331-ca0acda2281b tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5" status: 404 len: 111 microversion: 2.1 time: 0.048732 Feb 21 00:59:16.704123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 569/953] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:16 2022] GET /compute/v2.1/servers/eaf1e55d-f089-4700-84ba-c7daee664ac5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:59:16.713102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-300c98d3-e5e8-4737-aaf4-fefe1e8e6b44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.713726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-300c98d3-e5e8-4737-aaf4-fefe1e8e6b44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.724627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-300c98d3-e5e8-4737-aaf4-fefe1e8e6b44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.725127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-300c98d3-e5e8-4737-aaf4-fefe1e8e6b44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.728221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-300c98d3-e5e8-4737-aaf4-fefe1e8e6b44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.728853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-300c98d3-e5e8-4737-aaf4-fefe1e8e6b44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.743162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1a13d84d-ce3e-42dd-8a05-ec587ee3db3f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 204 len: 0 microversion: 2.1 time: 0.179404 Feb 21 00:59:16.744088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 385/954] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 00:59:16 2022] DELETE /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 00:59:16.811359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-300c98d3-e5e8-4737-aaf4-fefe1e8e6b44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:16.816495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-a3a77e1d-87c0-4794-8b32-585abd3ed5da req-c0d254f8-ab9b-423e-a105-e5aba805cb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d201f02-8582-4720-942e-8d62400e176f", "name": "network-vif-deleted", "tag": "bf929627-3fbe-4a88-9f95-bbe9870fa556"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:59:16.818020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:59:16.818020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:59:16.820825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-300c98d3-e5e8-4737-aaf4-fefe1e8e6b44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.115232 Feb 21 00:59:16.821353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 570/955] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:16.833908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-77ca3e71-c510-4106-adee-01885e120d1e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:16.834639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-a3a77e1d-87c0-4794-8b32-585abd3ed5da req-c0d254f8-ab9b-423e-a105-e5aba805cb90 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.834861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-77ca3e71-c510-4106-adee-01885e120d1e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:16.835047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-a3a77e1d-87c0-4794-8b32-585abd3ed5da req-c0d254f8-ab9b-423e-a105-e5aba805cb90 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.841761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-77ca3e71-c510-4106-adee-01885e120d1e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.842404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-77ca3e71-c510-4106-adee-01885e120d1e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.843576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-77ca3e71-c510-4106-adee-01885e120d1e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:16.844301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-77ca3e71-c510-4106-adee-01885e120d1e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:16.846810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-a3a77e1d-87c0-4794-8b32-585abd3ed5da req-c0d254f8-ab9b-423e-a105-e5aba805cb90 service nova] Creating event network-vif-deleted:bf929627-3fbe-4a88-9f95-bbe9870fa556 for instance 9d201f02-8582-4720-942e-8d62400e176f on hv-cinder-81322 Feb 21 00:59:16.851805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-a3a77e1d-87c0-4794-8b32-585abd3ed5da req-c0d254f8-ab9b-423e-a105-e5aba805cb90 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106175 Feb 21 00:59:16.852772 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 386/956] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:59:16.989938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-77ca3e71-c510-4106-adee-01885e120d1e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:16.997395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-77ca3e71-c510-4106-adee-01885e120d1e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1670 microversion: 2.1 time: 0.175089 Feb 21 00:59:16.997963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 571/957] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:16 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:17.839347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3df70cc2-6502-42eb-92b0-f97589f14f49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:17.839953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3df70cc2-6502-42eb-92b0-f97589f14f49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:17.846925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3df70cc2-6502-42eb-92b0-f97589f14f49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:17.847366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3df70cc2-6502-42eb-92b0-f97589f14f49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:17.848154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3df70cc2-6502-42eb-92b0-f97589f14f49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:17.848620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3df70cc2-6502-42eb-92b0-f97589f14f49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:18.015383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1fbbfeac-0113-489b-bb92-4ea39f0502e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:18.015999 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1fbbfeac-0113-489b-bb92-4ea39f0502e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:18.023191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1fbbfeac-0113-489b-bb92-4ea39f0502e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:18.023631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1fbbfeac-0113-489b-bb92-4ea39f0502e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:18.024416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1fbbfeac-0113-489b-bb92-4ea39f0502e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:18.024883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1fbbfeac-0113-489b-bb92-4ea39f0502e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:18.069908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3df70cc2-6502-42eb-92b0-f97589f14f49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:18.077511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3df70cc2-6502-42eb-92b0-f97589f14f49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.242848 Feb 21 00:59:18.078361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 387/958] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:17 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:18.164918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1fbbfeac-0113-489b-bb92-4ea39f0502e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:18.172336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1fbbfeac-0113-489b-bb92-4ea39f0502e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1670 microversion: 2.1 time: 0.160657 Feb 21 00:59:18.172937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 572/959] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:18 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:18.871901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-ebd59a85-b969-437e-87ec-14761787c9aa req-8da04b51-167a-4fd5-b2be-7be6993a3d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2482a368-86ed-4e3c-aa3d-e414ae527066", "name": "network-vif-deleted", "tag": "3e28f716-bca9-4286-8b93-1948b2352ec2"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:59:18.873965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:59:18.873965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:59:18.882165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-ebd59a85-b969-437e-87ec-14761787c9aa req-8da04b51-167a-4fd5-b2be-7be6993a3d6f service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:18.883654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-ebd59a85-b969-437e-87ec-14761787c9aa req-8da04b51-167a-4fd5-b2be-7be6993a3d6f service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:18.897400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-ebd59a85-b969-437e-87ec-14761787c9aa req-8da04b51-167a-4fd5-b2be-7be6993a3d6f service nova] Creating event network-vif-deleted:3e28f716-bca9-4286-8b93-1948b2352ec2 for instance 2482a368-86ed-4e3c-aa3d-e414ae527066 on hv-cinder-81322 Feb 21 00:59:18.902113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-ebd59a85-b969-437e-87ec-14761787c9aa req-8da04b51-167a-4fd5-b2be-7be6993a3d6f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035939 Feb 21 00:59:18.903237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 388/960] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:59:19.094169 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-06247cac-8102-46ba-85a2-e656a610410b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:19.094819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-06247cac-8102-46ba-85a2-e656a610410b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:19.101584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06247cac-8102-46ba-85a2-e656a610410b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:19.102024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06247cac-8102-46ba-85a2-e656a610410b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:19.102803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06247cac-8102-46ba-85a2-e656a610410b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:19.103231 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06247cac-8102-46ba-85a2-e656a610410b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:19.164846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-06247cac-8102-46ba-85a2-e656a610410b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:19.172585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-06247cac-8102-46ba-85a2-e656a610410b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.082311 Feb 21 00:59:19.173319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 573/961] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:19 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:19.192904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:19.193799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:19.200069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:19.200642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:19.201421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:19.201883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:19.235798 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:19.236245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:19.236723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lazy-loading 'fault' on Instance uuid 2482a368-86ed-4e3c-aa3d-e414ae527066 {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 00:59:19.279479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:19.288804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-454884dc-3c6a-4794-9b6e-daaa3e8985d1 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 200 len: 1326 microversion: 2.1 time: 0.102339 Feb 21 00:59:19.300016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 389/962] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:19 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:20.192922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7af61ef4-a68b-481e-8bd9-2034d6ea617f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:20.193758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7af61ef4-a68b-481e-8bd9-2034d6ea617f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:20.204531 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7af61ef4-a68b-481e-8bd9-2034d6ea617f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:20.204980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7af61ef4-a68b-481e-8bd9-2034d6ea617f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:20.205765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7af61ef4-a68b-481e-8bd9-2034d6ea617f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:20.206171 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7af61ef4-a68b-481e-8bd9-2034d6ea617f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:20.278103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7af61ef4-a68b-481e-8bd9-2034d6ea617f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:20.285887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7af61ef4-a68b-481e-8bd9-2034d6ea617f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.099486 Feb 21 00:59:20.286454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 574/963] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:20 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:20.306910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:20.307609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:20.314083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:20.314504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:20.315296 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:20.315706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:20.328337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] HTTP exception thrown: Instance 2482a368-86ed-4e3c-aa3d-e414ae527066 could not be found. Feb 21 00:59:20.328911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Returning 404 to user: Instance 2482a368-86ed-4e3c-aa3d-e414ae527066 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 00:59:20.329819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3ada7195-0150-42c0-8317-fdfc4de2697a tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 404 len: 111 microversion: 2.1 time: 0.026677 Feb 21 00:59:20.330331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 390/964] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:20 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 00:59:20.338570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-76d7fc92-6bd5-4dc5-9c93-307df8e5fe15 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '.version_select at 0x7fe56cce14c0>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:20.362219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-76d7fc92-6bd5-4dc5-9c93-307df8e5fe15 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726585088" status: 202 len: 0 microversion: 2.1 time: 0.027278 Feb 21 00:59:20.362775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 575/965] 10.222.0.72 () {58 vars in 1217 bytes} [Mon Feb 21 00:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726585088 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 00:59:21.001537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-635909d7-d829-4680-ac85-f0323266ce6c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'create', calling method: .version_select at 0x7fe56d296c10>, body: {"keypair": {"name": "tempest-keypair-1205520788"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:59:21.016682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-635909d7-d829-4680-ac85-f0323266ce6c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for project c9e2484e716a4d078e8314885525ee23. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:59:21.021007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-635909d7-d829-4680-ac85-f0323266ce6c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for user 4bb4137c17e343e3a8d91ba801ecfbd9 and project c9e2484e716a4d078e8314885525ee23. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:59:21.149152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-635909d7-d829-4680-ac85-f0323266ce6c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for project c9e2484e716a4d078e8314885525ee23. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:59:21.152839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-635909d7-d829-4680-ac85-f0323266ce6c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for user 4bb4137c17e343e3a8d91ba801ecfbd9 and project c9e2484e716a4d078e8314885525ee23. Resources: {'key_pairs'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:59:21.166048 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-635909d7-d829-4680-ac85-f0323266ce6c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.168430 Feb 21 00:59:21.166827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 391/966] 10.222.0.72 () {60 vars in 1157 bytes} [Mon Feb 21 00:59:20 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:21.303653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-043752d0-6468-493e-a438-3138918036ac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:21.304614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-043752d0-6468-493e-a438-3138918036ac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:21.312412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-043752d0-6468-493e-a438-3138918036ac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:21.312949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-043752d0-6468-493e-a438-3138918036ac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:21.313877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-043752d0-6468-493e-a438-3138918036ac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:21.314672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-043752d0-6468-493e-a438-3138918036ac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:21.380597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-043752d0-6468-493e-a438-3138918036ac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:21.388211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-043752d0-6468-493e-a438-3138918036ac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089336 Feb 21 00:59:21.388832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 576/967] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:21 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:22.404633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-81f2b386-f59f-4e15-85a8-0b5835460537 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:22.405755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-81f2b386-f59f-4e15-85a8-0b5835460537 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:22.412031 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81f2b386-f59f-4e15-85a8-0b5835460537 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:22.412507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81f2b386-f59f-4e15-85a8-0b5835460537 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:22.413283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81f2b386-f59f-4e15-85a8-0b5835460537 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:22.413710 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81f2b386-f59f-4e15-85a8-0b5835460537 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:22.472639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1633610007", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "598c85cd-5729-4005-9409-664298fecc1d"}], "security_groups": [{"name": "tempest-securitygroup--88551402"}], "key_name": "tempest-keypair-1205520788", "user_data": "}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:59:22.474648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-81f2b386-f59f-4e15-85a8-0b5835460537 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:22.482937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-81f2b386-f59f-4e15-85a8-0b5835460537 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.082216 Feb 21 00:59:22.483513 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 392/968] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:22 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:22.573281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] validate_networks() for [('598c85cd-5729-4005-9409-664298fecc1d', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 00:59:22.996570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 00:59:22.997025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 00:59:22.997496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 00:59:22.997904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 00:59:22.998309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 00:59:23.007845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:23.008291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:23.009132 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:23.009561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:23.026159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for project c9e2484e716a4d078e8314885525ee23. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 00:59:23.030870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Getting quotas for user 4bb4137c17e343e3a8d91ba801ecfbd9 and project c9e2484e716a4d078e8314885525ee23. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 00:59:23.043789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 00:59:23.046476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 00:59:23.095716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a3ec652b-e4c5-44be-9f00-89e96df189e5 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.627414 Feb 21 00:59:23.096360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 577/969] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 00:59:22 2022] POST /compute/v2.1/servers => generated 400 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 00:59:23.106335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f0d26ceb-88bf-4893-aa7d-81a577cbfd48 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:23.107040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f0d26ceb-88bf-4893-aa7d-81a577cbfd48 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:23.162993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f0d26ceb-88bf-4893-aa7d-81a577cbfd48 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:23.169532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f0d26ceb-88bf-4893-aa7d-81a577cbfd48 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1238 microversion: 2.1 time: 0.066905 Feb 21 00:59:23.170253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 393/970] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:23 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:23.499880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-375812b3-5793-40e7-ad8c-3682ba82635e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:23.501209 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-375812b3-5793-40e7-ad8c-3682ba82635e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:23.510422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-375812b3-5793-40e7-ad8c-3682ba82635e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:23.510958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-375812b3-5793-40e7-ad8c-3682ba82635e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:23.511818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-375812b3-5793-40e7-ad8c-3682ba82635e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:23.512332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-375812b3-5793-40e7-ad8c-3682ba82635e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:23.580960 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-375812b3-5793-40e7-ad8c-3682ba82635e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:23.590190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-375812b3-5793-40e7-ad8c-3682ba82635e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094872 Feb 21 00:59:23.590760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 578/971] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:23 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:24.186715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-696c42a8-145b-4e56-986e-c9b574a01b1c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:24.187353 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-696c42a8-145b-4e56-986e-c9b574a01b1c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:24.193861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-696c42a8-145b-4e56-986e-c9b574a01b1c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:24.194304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-696c42a8-145b-4e56-986e-c9b574a01b1c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:24.195283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-696c42a8-145b-4e56-986e-c9b574a01b1c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:24.195713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-696c42a8-145b-4e56-986e-c9b574a01b1c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:24.266471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-696c42a8-145b-4e56-986e-c9b574a01b1c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:24.275495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-696c42a8-145b-4e56-986e-c9b574a01b1c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1308 microversion: 2.1 time: 0.092495 Feb 21 00:59:24.276233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 394/972] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:24 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:24.607146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9b5f25ba-33a4-46f2-b167-aeadba092c37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:24.607761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9b5f25ba-33a4-46f2-b167-aeadba092c37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:24.614702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9b5f25ba-33a4-46f2-b167-aeadba092c37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:24.615164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9b5f25ba-33a4-46f2-b167-aeadba092c37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:24.615941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9b5f25ba-33a4-46f2-b167-aeadba092c37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:24.616365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9b5f25ba-33a4-46f2-b167-aeadba092c37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:24.677796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9b5f25ba-33a4-46f2-b167-aeadba092c37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:24.685477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9b5f25ba-33a4-46f2-b167-aeadba092c37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.082097 Feb 21 00:59:24.686112 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 579/973] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:24 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:25.293115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-07ede55c-ac71-4abd-b6f1-908f84e41d0c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:25.294158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-07ede55c-ac71-4abd-b6f1-908f84e41d0c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:25.302557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07ede55c-ac71-4abd-b6f1-908f84e41d0c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:25.303009 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07ede55c-ac71-4abd-b6f1-908f84e41d0c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:25.303985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07ede55c-ac71-4abd-b6f1-908f84e41d0c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:25.304500 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07ede55c-ac71-4abd-b6f1-908f84e41d0c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:25.507106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-07ede55c-ac71-4abd-b6f1-908f84e41d0c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:25.514596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-07ede55c-ac71-4abd-b6f1-908f84e41d0c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1362 microversion: 2.1 time: 0.225446 Feb 21 00:59:25.515169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 395/974] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:25 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:25.559235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-b4443003-292b-489f-9f09-5625cb225ae7 req-33192ea1-97c0-4ed5-801f-3f0e716982b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e", "tag": "9e7311a4-291e-4b74-acef-de7ecb911272"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:59:25.561295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:59:25.561295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:59:25.568730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-b4443003-292b-489f-9f09-5625cb225ae7 req-33192ea1-97c0-4ed5-801f-3f0e716982b5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:25.569169 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-b4443003-292b-489f-9f09-5625cb225ae7 req-33192ea1-97c0-4ed5-801f-3f0e716982b5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:25.581749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-b4443003-292b-489f-9f09-5625cb225ae7 req-33192ea1-97c0-4ed5-801f-3f0e716982b5 service nova] Creating event network-changed:9e7311a4-291e-4b74-acef-de7ecb911272 for instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e on hv-cinder-81322 Feb 21 00:59:25.586980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-b4443003-292b-489f-9f09-5625cb225ae7 req-33192ea1-97c0-4ed5-801f-3f0e716982b5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032606 Feb 21 00:59:25.588221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 580/975] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:59:25.702488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f9bfd535-776f-4a57-9164-abad9654cc6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:25.703164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f9bfd535-776f-4a57-9164-abad9654cc6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:25.709454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f9bfd535-776f-4a57-9164-abad9654cc6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:25.709893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f9bfd535-776f-4a57-9164-abad9654cc6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:25.710660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f9bfd535-776f-4a57-9164-abad9654cc6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:25.711078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f9bfd535-776f-4a57-9164-abad9654cc6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:25.777323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f9bfd535-776f-4a57-9164-abad9654cc6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:25.786221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f9bfd535-776f-4a57-9164-abad9654cc6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087572 Feb 21 00:59:25.786790 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 396/976] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:25 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:26.535894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-70d90e10-2405-44c3-b8d6-83d9b01ce01f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:26.536645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-70d90e10-2405-44c3-b8d6-83d9b01ce01f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:26.543083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-70d90e10-2405-44c3-b8d6-83d9b01ce01f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:26.543497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-70d90e10-2405-44c3-b8d6-83d9b01ce01f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:26.544295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-70d90e10-2405-44c3-b8d6-83d9b01ce01f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:26.544850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-70d90e10-2405-44c3-b8d6-83d9b01ce01f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:26.686533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-70d90e10-2405-44c3-b8d6-83d9b01ce01f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:26.694670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-70d90e10-2405-44c3-b8d6-83d9b01ce01f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1362 microversion: 2.1 time: 0.163502 Feb 21 00:59:26.695183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 581/977] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:26 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:26.806979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8b3717e8-c3aa-4190-b4d5-c26dd16b35af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:26.807989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8b3717e8-c3aa-4190-b4d5-c26dd16b35af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:26.816979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b3717e8-c3aa-4190-b4d5-c26dd16b35af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:26.817422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b3717e8-c3aa-4190-b4d5-c26dd16b35af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:26.818190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b3717e8-c3aa-4190-b4d5-c26dd16b35af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:26.818616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b3717e8-c3aa-4190-b4d5-c26dd16b35af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:26.885158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8b3717e8-c3aa-4190-b4d5-c26dd16b35af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:26.893390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8b3717e8-c3aa-4190-b4d5-c26dd16b35af tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092629 Feb 21 00:59:26.893958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 397/978] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:27.715948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-495639fe-00ce-4fb2-b2ad-4cce6f269571 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:27.716946 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-495639fe-00ce-4fb2-b2ad-4cce6f269571 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:27.727820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-495639fe-00ce-4fb2-b2ad-4cce6f269571 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:27.728619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-495639fe-00ce-4fb2-b2ad-4cce6f269571 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:27.729884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-495639fe-00ce-4fb2-b2ad-4cce6f269571 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:27.730596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-495639fe-00ce-4fb2-b2ad-4cce6f269571 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:27.885614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-495639fe-00ce-4fb2-b2ad-4cce6f269571 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:27.896053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-495639fe-00ce-4fb2-b2ad-4cce6f269571 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1362 microversion: 2.1 time: 0.186534 Feb 21 00:59:27.896741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 582/979] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:27 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:27.913459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-86c4456c-8ec3-4d65-89af-a2f3b312c781 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:27.914439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-86c4456c-8ec3-4d65-89af-a2f3b312c781 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:27.924237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-86c4456c-8ec3-4d65-89af-a2f3b312c781 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:27.924713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-86c4456c-8ec3-4d65-89af-a2f3b312c781 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:27.925488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-86c4456c-8ec3-4d65-89af-a2f3b312c781 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:27.925915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-86c4456c-8ec3-4d65-89af-a2f3b312c781 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:28.000731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-86c4456c-8ec3-4d65-89af-a2f3b312c781 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:28.008677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-86c4456c-8ec3-4d65-89af-a2f3b312c781 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.101320 Feb 21 00:59:28.009269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 398/980] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:28.913813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0fa93c00-1643-4c83-ade1-00485ce72fa8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:28.914417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0fa93c00-1643-4c83-ade1-00485ce72fa8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:28.921130 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0fa93c00-1643-4c83-ade1-00485ce72fa8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:28.921569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0fa93c00-1643-4c83-ade1-00485ce72fa8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:28.922339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0fa93c00-1643-4c83-ade1-00485ce72fa8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:28.922764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0fa93c00-1643-4c83-ade1-00485ce72fa8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:29.030358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-23042dc0-a464-4cc4-a789-87056ef71e31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:29.030995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-23042dc0-a464-4cc4-a789-87056ef71e31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:29.037400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23042dc0-a464-4cc4-a789-87056ef71e31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:29.037844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23042dc0-a464-4cc4-a789-87056ef71e31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:29.038616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23042dc0-a464-4cc4-a789-87056ef71e31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:29.039042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-23042dc0-a464-4cc4-a789-87056ef71e31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:29.065929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0fa93c00-1643-4c83-ade1-00485ce72fa8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:29.073958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0fa93c00-1643-4c83-ade1-00485ce72fa8 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1362 microversion: 2.1 time: 0.163856 Feb 21 00:59:29.074625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 583/981] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:28 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:29.097371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-23042dc0-a464-4cc4-a789-87056ef71e31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:29.104636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-23042dc0-a464-4cc4-a789-87056ef71e31 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.078329 Feb 21 00:59:29.105170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 399/982] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:29 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:30.094524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-087f9828-6b32-436b-a6b7-704aa9247526 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:30.095594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-087f9828-6b32-436b-a6b7-704aa9247526 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:30.106664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-087f9828-6b32-436b-a6b7-704aa9247526 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:30.107465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-087f9828-6b32-436b-a6b7-704aa9247526 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:30.109144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-087f9828-6b32-436b-a6b7-704aa9247526 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:30.109922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-087f9828-6b32-436b-a6b7-704aa9247526 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:30.120720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4a5d26a3-273c-400d-81ba-e255d2419bd2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:30.121296 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4a5d26a3-273c-400d-81ba-e255d2419bd2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:30.128059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a5d26a3-273c-400d-81ba-e255d2419bd2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:30.128497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a5d26a3-273c-400d-81ba-e255d2419bd2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:30.129294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a5d26a3-273c-400d-81ba-e255d2419bd2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:30.129719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a5d26a3-273c-400d-81ba-e255d2419bd2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:30.189498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4a5d26a3-273c-400d-81ba-e255d2419bd2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:30.197064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4a5d26a3-273c-400d-81ba-e255d2419bd2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.080058 Feb 21 00:59:30.197646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 400/983] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:30 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:30.246874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-087f9828-6b32-436b-a6b7-704aa9247526 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:30.255954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-087f9828-6b32-436b-a6b7-704aa9247526 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1362 microversion: 2.1 time: 0.167639 Feb 21 00:59:30.256578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 584/984] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:30 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:31.215013 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a7450ca9-6aeb-4e81-8d1a-68cb71d0df4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:31.215646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a7450ca9-6aeb-4e81-8d1a-68cb71d0df4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:31.223181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7450ca9-6aeb-4e81-8d1a-68cb71d0df4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:31.223622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7450ca9-6aeb-4e81-8d1a-68cb71d0df4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:31.224424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7450ca9-6aeb-4e81-8d1a-68cb71d0df4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:31.224882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7450ca9-6aeb-4e81-8d1a-68cb71d0df4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:31.271933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8591a66d-1a62-4710-837f-693649770cdb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:31.273173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8591a66d-1a62-4710-837f-693649770cdb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:31.280022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8591a66d-1a62-4710-837f-693649770cdb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:31.280493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8591a66d-1a62-4710-837f-693649770cdb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:31.281264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8591a66d-1a62-4710-837f-693649770cdb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:31.281681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8591a66d-1a62-4710-837f-693649770cdb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:31.290277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a7450ca9-6aeb-4e81-8d1a-68cb71d0df4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:31.298099 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a7450ca9-6aeb-4e81-8d1a-68cb71d0df4a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087437 Feb 21 00:59:31.298664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 401/985] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:31 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:31.417622 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8591a66d-1a62-4710-837f-693649770cdb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:31.425161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8591a66d-1a62-4710-837f-693649770cdb tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1362 microversion: 2.1 time: 0.156909 Feb 21 00:59:31.425705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 585/986] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:31 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 00:59:32.315087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-14bdc345-03c5-4a69-8c07-8f03121758de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:32.315801 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-14bdc345-03c5-4a69-8c07-8f03121758de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:32.322530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-14bdc345-03c5-4a69-8c07-8f03121758de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:32.322960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-14bdc345-03c5-4a69-8c07-8f03121758de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:32.323738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-14bdc345-03c5-4a69-8c07-8f03121758de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:32.324166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-14bdc345-03c5-4a69-8c07-8f03121758de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:32.386438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-14bdc345-03c5-4a69-8c07-8f03121758de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:32.394218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-14bdc345-03c5-4a69-8c07-8f03121758de tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.082876 Feb 21 00:59:32.394813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 402/987] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:32 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:32.442267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5ffbde91-82cc-41e0-ba91-5dfbf944d21f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:32.443997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5ffbde91-82cc-41e0-ba91-5dfbf944d21f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:32.451046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ffbde91-82cc-41e0-ba91-5dfbf944d21f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:32.451495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ffbde91-82cc-41e0-ba91-5dfbf944d21f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:32.452285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ffbde91-82cc-41e0-ba91-5dfbf944d21f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:32.453087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ffbde91-82cc-41e0-ba91-5dfbf944d21f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:32.550372 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-dbdc0709-4eeb-428b-a61c-2a7625202fdc req-41c7014f-bacc-4929-a7ce-c762406428c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e", "name": "network-vif-plugged", "status": "completed", "tag": "9e7311a4-291e-4b74-acef-de7ecb911272"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:59:32.551966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:59:32.551966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 00:59:32.559025 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-dbdc0709-4eeb-428b-a61c-2a7625202fdc req-41c7014f-bacc-4929-a7ce-c762406428c2 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:32.559454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-dbdc0709-4eeb-428b-a61c-2a7625202fdc req-41c7014f-bacc-4929-a7ce-c762406428c2 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:32.572158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-dbdc0709-4eeb-428b-a61c-2a7625202fdc req-41c7014f-bacc-4929-a7ce-c762406428c2 service nova] Creating event network-vif-plugged:9e7311a4-291e-4b74-acef-de7ecb911272 for instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e on hv-cinder-81322 Feb 21 00:59:32.577731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-dbdc0709-4eeb-428b-a61c-2a7625202fdc req-41c7014f-bacc-4929-a7ce-c762406428c2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116607 Feb 21 00:59:32.578355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 403/988] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:59:32.621332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5ffbde91-82cc-41e0-ba91-5dfbf944d21f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:32.629366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5ffbde91-82cc-41e0-ba91-5dfbf944d21f tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1362 microversion: 2.1 time: 0.190992 Feb 21 00:59:32.630091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 586/989] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:32 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:33.418450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4eb99ae0-3d32-44c3-9d0a-0c873bdd9f93 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:33.419596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4eb99ae0-3d32-44c3-9d0a-0c873bdd9f93 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:33.430445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4eb99ae0-3d32-44c3-9d0a-0c873bdd9f93 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:33.431316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4eb99ae0-3d32-44c3-9d0a-0c873bdd9f93 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:33.432506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4eb99ae0-3d32-44c3-9d0a-0c873bdd9f93 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:33.433277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4eb99ae0-3d32-44c3-9d0a-0c873bdd9f93 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:33.497879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4eb99ae0-3d32-44c3-9d0a-0c873bdd9f93 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:33.505516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4eb99ae0-3d32-44c3-9d0a-0c873bdd9f93 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094906 Feb 21 00:59:33.506086 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 404/990] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:33 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:33.650484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5e8705fa-e724-46b3-9436-9a963645b98c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:33.651575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5e8705fa-e724-46b3-9436-9a963645b98c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:33.662454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e8705fa-e724-46b3-9436-9a963645b98c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:33.663185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e8705fa-e724-46b3-9436-9a963645b98c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:33.664451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e8705fa-e724-46b3-9436-9a963645b98c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:33.665235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e8705fa-e724-46b3-9436-9a963645b98c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:33.822417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5e8705fa-e724-46b3-9436-9a963645b98c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:33.830177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5e8705fa-e724-46b3-9436-9a963645b98c tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1362 microversion: 2.1 time: 0.186000 Feb 21 00:59:33.830720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 587/991] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:33 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:34.525032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-af1bd366-2a04-4c91-add8-6ba6954887f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:34.525949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-af1bd366-2a04-4c91-add8-6ba6954887f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:34.535378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af1bd366-2a04-4c91-add8-6ba6954887f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:34.535833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af1bd366-2a04-4c91-add8-6ba6954887f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:34.536687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af1bd366-2a04-4c91-add8-6ba6954887f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:34.537125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af1bd366-2a04-4c91-add8-6ba6954887f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:34.607511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-af1bd366-2a04-4c91-add8-6ba6954887f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:34.615730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-af1bd366-2a04-4c91-add8-6ba6954887f9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096522 Feb 21 00:59:34.616309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 405/992] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:34 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:34.851263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6bb141c3-0592-432f-876b-f25f1d7153d7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:34.852188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6bb141c3-0592-432f-876b-f25f1d7153d7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:34.863257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6bb141c3-0592-432f-876b-f25f1d7153d7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:34.864015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6bb141c3-0592-432f-876b-f25f1d7153d7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:34.865513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6bb141c3-0592-432f-876b-f25f1d7153d7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:34.866432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6bb141c3-0592-432f-876b-f25f1d7153d7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:35.015615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6bb141c3-0592-432f-876b-f25f1d7153d7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:35.027967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6bb141c3-0592-432f-876b-f25f1d7153d7 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1547 microversion: 2.1 time: 0.183539 Feb 21 00:59:35.028935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 588/993] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:34 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:35.044917 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-432fd475-a1ba-4a48-a78d-e6e0961c8958 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:35.045412 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-432fd475-a1ba-4a48-a78d-e6e0961c8958 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:35.051408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-432fd475-a1ba-4a48-a78d-e6e0961c8958 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:35.051852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-432fd475-a1ba-4a48-a78d-e6e0961c8958 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:35.052679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-432fd475-a1ba-4a48-a78d-e6e0961c8958 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:35.053109 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-432fd475-a1ba-4a48-a78d-e6e0961c8958 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:35.140115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-432fd475-a1ba-4a48-a78d-e6e0961c8958 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098792 Feb 21 00:59:35.140749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 406/994] 10.222.0.72 () {58 vars in 1274 bytes} [Mon Feb 21 00:59:35 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:59:35.633464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-47cb104c-864f-4f7a-958a-aecb04c04c6e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:35.634083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-47cb104c-864f-4f7a-958a-aecb04c04c6e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:35.640803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47cb104c-864f-4f7a-958a-aecb04c04c6e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:35.641245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47cb104c-864f-4f7a-958a-aecb04c04c6e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:35.642032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47cb104c-864f-4f7a-958a-aecb04c04c6e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:35.642458 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-47cb104c-864f-4f7a-958a-aecb04c04c6e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:35.705893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-47cb104c-864f-4f7a-958a-aecb04c04c6e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:35.714063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-47cb104c-864f-4f7a-958a-aecb04c04c6e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084461 Feb 21 00:59:35.714620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 589/995] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:35 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:36.374945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-39119c12-ffbe-41c2-b044-930fdbd66faf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:36.375486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-39119c12-ffbe-41c2-b044-930fdbd66faf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:36.376810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-ee5ea929-6d21-48c4-8cae-739008ae8654 req-1c05c674-52f8-47ec-8df5-ecfbdb63f2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e", "tag": "9e7311a4-291e-4b74-acef-de7ecb911272"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 00:59:36.378717 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:59:36.378717 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 00:59:36.382042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-39119c12-ffbe-41c2-b044-930fdbd66faf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:36.382479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-39119c12-ffbe-41c2-b044-930fdbd66faf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:36.383263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-39119c12-ffbe-41c2-b044-930fdbd66faf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:36.383860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-39119c12-ffbe-41c2-b044-930fdbd66faf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:36.386267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-ee5ea929-6d21-48c4-8cae-739008ae8654 req-1c05c674-52f8-47ec-8df5-ecfbdb63f2ed service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:36.386781 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-ee5ea929-6d21-48c4-8cae-739008ae8654 req-1c05c674-52f8-47ec-8df5-ecfbdb63f2ed service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:36.398619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-ee5ea929-6d21-48c4-8cae-739008ae8654 req-1c05c674-52f8-47ec-8df5-ecfbdb63f2ed service nova] Creating event network-changed:9e7311a4-291e-4b74-acef-de7ecb911272 for instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e on hv-cinder-81322 Feb 21 00:59:36.404616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-ee5ea929-6d21-48c4-8cae-739008ae8654 req-1c05c674-52f8-47ec-8df5-ecfbdb63f2ed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030785 Feb 21 00:59:36.405246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 590/996] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 00:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 00:59:36.409194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-39119c12-ffbe-41c2-b044-930fdbd66faf tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e/ips" status: 200 len: 105 microversion: 2.1 time: 0.037827 Feb 21 00:59:36.409736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 407/997] 10.222.0.72 () {58 vars in 1247 bytes} [Mon Feb 21 00:59:36 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e/ips => generated 105 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 00:59:36.731427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e17bf917-5793-4287-bde8-2283d948e324 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:36.732062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e17bf917-5793-4287-bde8-2283d948e324 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:36.739465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e17bf917-5793-4287-bde8-2283d948e324 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:36.739465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e17bf917-5793-4287-bde8-2283d948e324 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:36.739465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e17bf917-5793-4287-bde8-2283d948e324 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:36.739986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e17bf917-5793-4287-bde8-2283d948e324 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:36.803590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e17bf917-5793-4287-bde8-2283d948e324 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:36.811309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e17bf917-5793-4287-bde8-2283d948e324 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083858 Feb 21 00:59:36.812210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 591/998] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:36 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:37.832623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f0a77a42-acb3-4316-af09-c58c833c7333 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:37.833592 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f0a77a42-acb3-4316-af09-c58c833c7333 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:37.844197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0a77a42-acb3-4316-af09-c58c833c7333 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:37.845001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0a77a42-acb3-4316-af09-c58c833c7333 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:37.846311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0a77a42-acb3-4316-af09-c58c833c7333 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:37.846754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0a77a42-acb3-4316-af09-c58c833c7333 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:37.907864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f0a77a42-acb3-4316-af09-c58c833c7333 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:37.915448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f0a77a42-acb3-4316-af09-c58c833c7333 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089442 Feb 21 00:59:37.916012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 408/999] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:38.939242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4ec83c76-a312-461e-a94d-27c51b2030cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:38.940204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4ec83c76-a312-461e-a94d-27c51b2030cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:38.951089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ec83c76-a312-461e-a94d-27c51b2030cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:38.951893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ec83c76-a312-461e-a94d-27c51b2030cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:38.953232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ec83c76-a312-461e-a94d-27c51b2030cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:38.953940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ec83c76-a312-461e-a94d-27c51b2030cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:39.025963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4ec83c76-a312-461e-a94d-27c51b2030cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:39.034618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4ec83c76-a312-461e-a94d-27c51b2030cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.104182 Feb 21 00:59:39.035191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 592/1000] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:38 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:40.055253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2deddb3e-e893-4412-942c-cde3b955da98 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:40.056311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2deddb3e-e893-4412-942c-cde3b955da98 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:40.066041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2deddb3e-e893-4412-942c-cde3b955da98 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:40.066485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2deddb3e-e893-4412-942c-cde3b955da98 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:40.067273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2deddb3e-e893-4412-942c-cde3b955da98 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:40.067704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2deddb3e-e893-4412-942c-cde3b955da98 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:40.139330 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2deddb3e-e893-4412-942c-cde3b955da98 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:40.150379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2deddb3e-e893-4412-942c-cde3b955da98 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100899 Feb 21 00:59:40.151128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 409/1001] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:40 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:41.171822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a296ba49-06cd-48ac-9b5d-1851a1962a0e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:41.172929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a296ba49-06cd-48ac-9b5d-1851a1962a0e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:41.180074 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a296ba49-06cd-48ac-9b5d-1851a1962a0e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:41.180552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a296ba49-06cd-48ac-9b5d-1851a1962a0e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:41.181323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a296ba49-06cd-48ac-9b5d-1851a1962a0e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:41.181746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a296ba49-06cd-48ac-9b5d-1851a1962a0e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:41.242538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a296ba49-06cd-48ac-9b5d-1851a1962a0e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:41.255197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a296ba49-06cd-48ac-9b5d-1851a1962a0e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089207 Feb 21 00:59:41.255931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 593/1002] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:42.276622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a29f6830-329d-4454-be9f-1f3668edc48a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:42.277693 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a29f6830-329d-4454-be9f-1f3668edc48a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:42.286869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a29f6830-329d-4454-be9f-1f3668edc48a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:42.287311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a29f6830-329d-4454-be9f-1f3668edc48a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:42.288092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a29f6830-329d-4454-be9f-1f3668edc48a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:42.288552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a29f6830-329d-4454-be9f-1f3668edc48a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:42.358223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a29f6830-329d-4454-be9f-1f3668edc48a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:42.365908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a29f6830-329d-4454-be9f-1f3668edc48a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095628 Feb 21 00:59:42.366511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 410/1003] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:42 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:43.386222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-04a87c35-a78a-4a28-b563-aa2fe6446164 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:43.387187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-04a87c35-a78a-4a28-b563-aa2fe6446164 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:43.396139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04a87c35-a78a-4a28-b563-aa2fe6446164 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:43.396616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04a87c35-a78a-4a28-b563-aa2fe6446164 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:43.397412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04a87c35-a78a-4a28-b563-aa2fe6446164 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:43.397812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04a87c35-a78a-4a28-b563-aa2fe6446164 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:43.471009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-04a87c35-a78a-4a28-b563-aa2fe6446164 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:43.478969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-04a87c35-a78a-4a28-b563-aa2fe6446164 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.098896 Feb 21 00:59:43.479512 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 594/1004] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:43 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:44.502369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f759a3d4-c87d-44e6-86ae-14b9f299762e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:44.504027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f759a3d4-c87d-44e6-86ae-14b9f299762e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:44.513570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f759a3d4-c87d-44e6-86ae-14b9f299762e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:44.514026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f759a3d4-c87d-44e6-86ae-14b9f299762e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:44.514808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f759a3d4-c87d-44e6-86ae-14b9f299762e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:44.515241 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f759a3d4-c87d-44e6-86ae-14b9f299762e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:44.740999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f759a3d4-c87d-44e6-86ae-14b9f299762e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:44.748916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f759a3d4-c87d-44e6-86ae-14b9f299762e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.255113 Feb 21 00:59:44.749503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 411/1005] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:44 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:45.768505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8cf45a29-f14a-46d0-a8c3-7c07445bbeb1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:45.769163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8cf45a29-f14a-46d0-a8c3-7c07445bbeb1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:45.776564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cf45a29-f14a-46d0-a8c3-7c07445bbeb1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:45.777068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cf45a29-f14a-46d0-a8c3-7c07445bbeb1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:45.777953 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cf45a29-f14a-46d0-a8c3-7c07445bbeb1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:45.778450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cf45a29-f14a-46d0-a8c3-7c07445bbeb1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:45.844315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8cf45a29-f14a-46d0-a8c3-7c07445bbeb1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:45.851899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8cf45a29-f14a-46d0-a8c3-7c07445bbeb1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089411 Feb 21 00:59:45.852493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 595/1006] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:45 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:46.873188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2ae09e02-72e9-4a62-9b96-9976f3228fdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:46.874155 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2ae09e02-72e9-4a62-9b96-9976f3228fdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:46.882204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ae09e02-72e9-4a62-9b96-9976f3228fdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:46.882654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ae09e02-72e9-4a62-9b96-9976f3228fdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:46.883445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ae09e02-72e9-4a62-9b96-9976f3228fdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:46.883877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ae09e02-72e9-4a62-9b96-9976f3228fdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:46.948216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2ae09e02-72e9-4a62-9b96-9976f3228fdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:46.955969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2ae09e02-72e9-4a62-9b96-9976f3228fdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089220 Feb 21 00:59:46.956539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 412/1007] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:46 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:47.977047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2d615343-55e1-4e53-bc92-0614b19001d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:47.977927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2d615343-55e1-4e53-bc92-0614b19001d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:47.988882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d615343-55e1-4e53-bc92-0614b19001d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:47.989628 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d615343-55e1-4e53-bc92-0614b19001d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:47.990930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d615343-55e1-4e53-bc92-0614b19001d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:47.991613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d615343-55e1-4e53-bc92-0614b19001d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:48.056840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2d615343-55e1-4e53-bc92-0614b19001d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:48.064425 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2d615343-55e1-4e53-bc92-0614b19001d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093874 Feb 21 00:59:48.064993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 596/1008] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:49.084638 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-56b095eb-5a87-469e-971f-39d8253ad61a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:49.085419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-56b095eb-5a87-469e-971f-39d8253ad61a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:49.093942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56b095eb-5a87-469e-971f-39d8253ad61a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:49.094527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56b095eb-5a87-469e-971f-39d8253ad61a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:49.095540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56b095eb-5a87-469e-971f-39d8253ad61a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:49.096108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-56b095eb-5a87-469e-971f-39d8253ad61a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:49.164556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-56b095eb-5a87-469e-971f-39d8253ad61a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:49.173219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-56b095eb-5a87-469e-971f-39d8253ad61a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094492 Feb 21 00:59:49.173774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 413/1009] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:49 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:50.191042 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce191c0c-ad79-44dd-b587-11a9536fef0b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:50.191635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce191c0c-ad79-44dd-b587-11a9536fef0b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:50.198649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce191c0c-ad79-44dd-b587-11a9536fef0b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:50.199082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce191c0c-ad79-44dd-b587-11a9536fef0b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:50.199872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce191c0c-ad79-44dd-b587-11a9536fef0b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:50.200302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce191c0c-ad79-44dd-b587-11a9536fef0b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:50.274681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce191c0c-ad79-44dd-b587-11a9536fef0b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:50.290821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce191c0c-ad79-44dd-b587-11a9536fef0b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.103551 Feb 21 00:59:50.291442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 597/1010] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:50 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:51.308166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-75ce6945-b66f-4296-8bd0-aee74b91c3c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:51.308889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-75ce6945-b66f-4296-8bd0-aee74b91c3c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:51.315606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75ce6945-b66f-4296-8bd0-aee74b91c3c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:51.316105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75ce6945-b66f-4296-8bd0-aee74b91c3c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:51.316934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75ce6945-b66f-4296-8bd0-aee74b91c3c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:51.317358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75ce6945-b66f-4296-8bd0-aee74b91c3c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:51.387128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-75ce6945-b66f-4296-8bd0-aee74b91c3c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:51.395022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-75ce6945-b66f-4296-8bd0-aee74b91c3c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090600 Feb 21 00:59:51.396277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 414/1011] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:52.416338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e7ce6136-9341-44a5-b723-b2a346cadbb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:52.417375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e7ce6136-9341-44a5-b723-b2a346cadbb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:52.428334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7ce6136-9341-44a5-b723-b2a346cadbb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:52.429118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7ce6136-9341-44a5-b723-b2a346cadbb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:52.430376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7ce6136-9341-44a5-b723-b2a346cadbb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:52.431078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7ce6136-9341-44a5-b723-b2a346cadbb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:52.494562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e7ce6136-9341-44a5-b723-b2a346cadbb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:52.502065 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e7ce6136-9341-44a5-b723-b2a346cadbb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092036 Feb 21 00:59:52.502640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 598/1012] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:53.522828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-98fc0a8d-3041-4587-ac83-9b14939f107e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:53.523472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-98fc0a8d-3041-4587-ac83-9b14939f107e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:53.531294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-98fc0a8d-3041-4587-ac83-9b14939f107e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:53.531785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-98fc0a8d-3041-4587-ac83-9b14939f107e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:53.532745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-98fc0a8d-3041-4587-ac83-9b14939f107e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:53.533358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-98fc0a8d-3041-4587-ac83-9b14939f107e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:53.594925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-98fc0a8d-3041-4587-ac83-9b14939f107e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:53.602717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-98fc0a8d-3041-4587-ac83-9b14939f107e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085434 Feb 21 00:59:53.603282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 415/1013] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:53 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:54.621986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b9b5c2dc-2451-461d-adef-ea085c7780be tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:54.622833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b9b5c2dc-2451-461d-adef-ea085c7780be tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:54.631685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9b5c2dc-2451-461d-adef-ea085c7780be tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:54.632131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9b5c2dc-2451-461d-adef-ea085c7780be tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:54.632943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9b5c2dc-2451-461d-adef-ea085c7780be tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:54.633374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9b5c2dc-2451-461d-adef-ea085c7780be tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:54.706231 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b9b5c2dc-2451-461d-adef-ea085c7780be tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:54.713832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b9b5c2dc-2451-461d-adef-ea085c7780be tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097232 Feb 21 00:59:54.714399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 599/1014] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:54 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:55.734546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-846f92f8-1d53-4a2c-b1eb-8780a8cf474e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:55.735532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-846f92f8-1d53-4a2c-b1eb-8780a8cf474e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:55.743738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-846f92f8-1d53-4a2c-b1eb-8780a8cf474e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:55.744173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-846f92f8-1d53-4a2c-b1eb-8780a8cf474e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:55.744979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-846f92f8-1d53-4a2c-b1eb-8780a8cf474e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:55.745402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-846f92f8-1d53-4a2c-b1eb-8780a8cf474e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:55.804045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-846f92f8-1d53-4a2c-b1eb-8780a8cf474e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:55.812111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-846f92f8-1d53-4a2c-b1eb-8780a8cf474e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083734 Feb 21 00:59:55.812724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 416/1015] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:56.833341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-add5fed2-8227-400a-8c50-7c91cf461000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:56.834202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-add5fed2-8227-400a-8c50-7c91cf461000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:56.844811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-add5fed2-8227-400a-8c50-7c91cf461000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:56.845554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-add5fed2-8227-400a-8c50-7c91cf461000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:56.846828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-add5fed2-8227-400a-8c50-7c91cf461000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:56.847543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-add5fed2-8227-400a-8c50-7c91cf461000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:56.911647 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-add5fed2-8227-400a-8c50-7c91cf461000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:56.919466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-add5fed2-8227-400a-8c50-7c91cf461000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092617 Feb 21 00:59:56.920067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 600/1016] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:57.945467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e12ccd8a-b738-447e-b0d8-20b7df033f6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:57.946324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e12ccd8a-b738-447e-b0d8-20b7df033f6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:57.956951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e12ccd8a-b738-447e-b0d8-20b7df033f6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:57.957694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e12ccd8a-b738-447e-b0d8-20b7df033f6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:57.958940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e12ccd8a-b738-447e-b0d8-20b7df033f6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:57.959371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e12ccd8a-b738-447e-b0d8-20b7df033f6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:58.022967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e12ccd8a-b738-447e-b0d8-20b7df033f6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:58.031120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e12ccd8a-b738-447e-b0d8-20b7df033f6a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092050 Feb 21 00:59:58.031682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 417/1017] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 00:59:59.051642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ec03b60b-8c10-4be0-8640-12689c42b8dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 00:59:59.052640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ec03b60b-8c10-4be0-8640-12689c42b8dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 00:59:59.062630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ec03b60b-8c10-4be0-8640-12689c42b8dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:59.063362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ec03b60b-8c10-4be0-8640-12689c42b8dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:59.064685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ec03b60b-8c10-4be0-8640-12689c42b8dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 00:59:59.065400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ec03b60b-8c10-4be0-8640-12689c42b8dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 00:59:59.126479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ec03b60b-8c10-4be0-8640-12689c42b8dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 00:59:59.134038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ec03b60b-8c10-4be0-8640-12689c42b8dc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088485 Feb 21 00:59:59.134607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 601/1018] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 00:59:59 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:00.151752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-40e279b8-b2d2-4f29-a49d-c527cc04ef6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:00.152367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-40e279b8-b2d2-4f29-a49d-c527cc04ef6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:00.159074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-40e279b8-b2d2-4f29-a49d-c527cc04ef6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:00.159525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-40e279b8-b2d2-4f29-a49d-c527cc04ef6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:00.160300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-40e279b8-b2d2-4f29-a49d-c527cc04ef6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:00.160771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-40e279b8-b2d2-4f29-a49d-c527cc04ef6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:00.220511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-40e279b8-b2d2-4f29-a49d-c527cc04ef6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:00.227965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-40e279b8-b2d2-4f29-a49d-c527cc04ef6d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.080115 Feb 21 01:00:00.228548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 418/1019] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:01.248880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3c609387-f5eb-4f88-9f2e-4549b78364a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:01.249496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3c609387-f5eb-4f88-9f2e-4549b78364a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:01.256193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3c609387-f5eb-4f88-9f2e-4549b78364a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:01.256613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3c609387-f5eb-4f88-9f2e-4549b78364a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:01.257387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3c609387-f5eb-4f88-9f2e-4549b78364a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:01.257835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3c609387-f5eb-4f88-9f2e-4549b78364a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:01.328627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3c609387-f5eb-4f88-9f2e-4549b78364a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:01.336450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3c609387-f5eb-4f88-9f2e-4549b78364a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091278 Feb 21 01:00:01.337034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 602/1020] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:01 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:02.361172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4ddb67c9-cd67-4b43-8bc4-c1db62960647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:02.362131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4ddb67c9-cd67-4b43-8bc4-c1db62960647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:02.374083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ddb67c9-cd67-4b43-8bc4-c1db62960647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:02.374818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ddb67c9-cd67-4b43-8bc4-c1db62960647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:02.376091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ddb67c9-cd67-4b43-8bc4-c1db62960647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:02.376869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ddb67c9-cd67-4b43-8bc4-c1db62960647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:02.441331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4ddb67c9-cd67-4b43-8bc4-c1db62960647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:02.449201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4ddb67c9-cd67-4b43-8bc4-c1db62960647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094271 Feb 21 01:00:02.449762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 419/1021] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:03.466364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-78c4fc53-b184-4ef6-a84b-e33444a204b0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:03.466949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-78c4fc53-b184-4ef6-a84b-e33444a204b0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:03.473727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78c4fc53-b184-4ef6-a84b-e33444a204b0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:03.474147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78c4fc53-b184-4ef6-a84b-e33444a204b0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:03.474925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78c4fc53-b184-4ef6-a84b-e33444a204b0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:03.475348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78c4fc53-b184-4ef6-a84b-e33444a204b0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:03.538060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-78c4fc53-b184-4ef6-a84b-e33444a204b0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:03.546097 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-78c4fc53-b184-4ef6-a84b-e33444a204b0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083638 Feb 21 01:00:03.546664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 603/1022] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:03 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:04.566967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2338918d-c8ef-4a29-b651-319402a70fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:04.567920 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2338918d-c8ef-4a29-b651-319402a70fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:04.574992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2338918d-c8ef-4a29-b651-319402a70fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:04.575427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2338918d-c8ef-4a29-b651-319402a70fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:04.576200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2338918d-c8ef-4a29-b651-319402a70fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:04.576665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2338918d-c8ef-4a29-b651-319402a70fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:04.646715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2338918d-c8ef-4a29-b651-319402a70fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:04.654756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2338918d-c8ef-4a29-b651-319402a70fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093996 Feb 21 01:00:04.655316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 420/1023] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:04 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:05.673847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c555802d-73e6-47b4-88e4-b2e9dc580748 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:05.674530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c555802d-73e6-47b4-88e4-b2e9dc580748 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:05.682518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c555802d-73e6-47b4-88e4-b2e9dc580748 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:05.682965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c555802d-73e6-47b4-88e4-b2e9dc580748 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:05.683756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c555802d-73e6-47b4-88e4-b2e9dc580748 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:05.684191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c555802d-73e6-47b4-88e4-b2e9dc580748 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:05.751937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c555802d-73e6-47b4-88e4-b2e9dc580748 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:05.760090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c555802d-73e6-47b4-88e4-b2e9dc580748 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090919 Feb 21 01:00:05.760710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 604/1024] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:05 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:06.781553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-99690209-94fb-4654-a8cb-6664c95ede95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:06.782458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-99690209-94fb-4654-a8cb-6664c95ede95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:06.790812 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-99690209-94fb-4654-a8cb-6664c95ede95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:06.791245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-99690209-94fb-4654-a8cb-6664c95ede95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:06.792015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-99690209-94fb-4654-a8cb-6664c95ede95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:06.792480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-99690209-94fb-4654-a8cb-6664c95ede95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:06.860195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-99690209-94fb-4654-a8cb-6664c95ede95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:06.867979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-99690209-94fb-4654-a8cb-6664c95ede95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093114 Feb 21 01:00:06.868608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 421/1025] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:06 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:07.889040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cc387818-a356-436f-9cd1-88f02b29ca73 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:07.889892 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cc387818-a356-436f-9cd1-88f02b29ca73 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:07.899076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc387818-a356-436f-9cd1-88f02b29ca73 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:07.899519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc387818-a356-436f-9cd1-88f02b29ca73 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:07.900292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc387818-a356-436f-9cd1-88f02b29ca73 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:07.900753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc387818-a356-436f-9cd1-88f02b29ca73 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:07.970349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cc387818-a356-436f-9cd1-88f02b29ca73 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:07.977889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cc387818-a356-436f-9cd1-88f02b29ca73 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095155 Feb 21 01:00:07.978665 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 605/1026] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:07 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:08.997794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8665e272-cc04-4289-b805-b0e17a803ee6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:08.998995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8665e272-cc04-4289-b805-b0e17a803ee6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:09.008660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8665e272-cc04-4289-b805-b0e17a803ee6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:09.009110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8665e272-cc04-4289-b805-b0e17a803ee6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:09.009860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8665e272-cc04-4289-b805-b0e17a803ee6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:09.010309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8665e272-cc04-4289-b805-b0e17a803ee6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:09.070031 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8665e272-cc04-4289-b805-b0e17a803ee6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:09.078139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8665e272-cc04-4289-b805-b0e17a803ee6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086617 Feb 21 01:00:09.078698 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 422/1027] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:08 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:10.099211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d77e42bd-e85a-4508-a5f2-a366fe527bb8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:10.100172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d77e42bd-e85a-4508-a5f2-a366fe527bb8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:10.111102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d77e42bd-e85a-4508-a5f2-a366fe527bb8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:10.111838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d77e42bd-e85a-4508-a5f2-a366fe527bb8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:10.113188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d77e42bd-e85a-4508-a5f2-a366fe527bb8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:10.113895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d77e42bd-e85a-4508-a5f2-a366fe527bb8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:10.181660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d77e42bd-e85a-4508-a5f2-a366fe527bb8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:10.193354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d77e42bd-e85a-4508-a5f2-a366fe527bb8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100150 Feb 21 01:00:10.194144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 606/1028] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:10 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:11.218992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cf72050a-4c49-4ba7-a6ad-e0a6c5013d8a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:11.220001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cf72050a-4c49-4ba7-a6ad-e0a6c5013d8a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:11.229322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cf72050a-4c49-4ba7-a6ad-e0a6c5013d8a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:11.229768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cf72050a-4c49-4ba7-a6ad-e0a6c5013d8a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:11.230545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cf72050a-4c49-4ba7-a6ad-e0a6c5013d8a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:11.230980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cf72050a-4c49-4ba7-a6ad-e0a6c5013d8a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:11.294408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cf72050a-4c49-4ba7-a6ad-e0a6c5013d8a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:11.302000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cf72050a-4c49-4ba7-a6ad-e0a6c5013d8a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089258 Feb 21 01:00:11.302552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 423/1029] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:11 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:12.322995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-877f323c-0a1d-4c09-9370-fa265d16b957 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:12.324071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-877f323c-0a1d-4c09-9370-fa265d16b957 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:12.335034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-877f323c-0a1d-4c09-9370-fa265d16b957 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:12.335879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-877f323c-0a1d-4c09-9370-fa265d16b957 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:12.336701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-877f323c-0a1d-4c09-9370-fa265d16b957 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:12.337135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-877f323c-0a1d-4c09-9370-fa265d16b957 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:12.407776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-877f323c-0a1d-4c09-9370-fa265d16b957 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:12.418968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-877f323c-0a1d-4c09-9370-fa265d16b957 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.102036 Feb 21 01:00:12.419696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 607/1030] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:12 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:13.439504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-060bcacb-93c1-4ed5-8e85-e653b540fe2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:13.440108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-060bcacb-93c1-4ed5-8e85-e653b540fe2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:13.447119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-060bcacb-93c1-4ed5-8e85-e653b540fe2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:13.447572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-060bcacb-93c1-4ed5-8e85-e653b540fe2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:13.448352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-060bcacb-93c1-4ed5-8e85-e653b540fe2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:13.448819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-060bcacb-93c1-4ed5-8e85-e653b540fe2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:13.509657 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-060bcacb-93c1-4ed5-8e85-e653b540fe2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:13.517816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-060bcacb-93c1-4ed5-8e85-e653b540fe2d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.082211 Feb 21 01:00:13.518386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 424/1031] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:14.539247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6d64eb15-9e3a-4e20-8acc-895a8a40c7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:14.540249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6d64eb15-9e3a-4e20-8acc-895a8a40c7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:14.551185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d64eb15-9e3a-4e20-8acc-895a8a40c7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:14.551895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d64eb15-9e3a-4e20-8acc-895a8a40c7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:14.553290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d64eb15-9e3a-4e20-8acc-895a8a40c7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:14.554009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d64eb15-9e3a-4e20-8acc-895a8a40c7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:14.615391 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6d64eb15-9e3a-4e20-8acc-895a8a40c7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:14.623800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6d64eb15-9e3a-4e20-8acc-895a8a40c7e9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090612 Feb 21 01:00:14.624375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 608/1032] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:15.644620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5f2c3d2f-7ae6-4eae-9661-0b4171ff69d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:15.645589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5f2c3d2f-7ae6-4eae-9661-0b4171ff69d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:15.656432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d2f-7ae6-4eae-9661-0b4171ff69d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:15.657196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d2f-7ae6-4eae-9661-0b4171ff69d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:15.658458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d2f-7ae6-4eae-9661-0b4171ff69d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:15.659164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d2f-7ae6-4eae-9661-0b4171ff69d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:15.733655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5f2c3d2f-7ae6-4eae-9661-0b4171ff69d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:15.741483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5f2c3d2f-7ae6-4eae-9661-0b4171ff69d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.103034 Feb 21 01:00:15.742045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 425/1033] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:16.761808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bdec94ea-2729-43a5-b686-de0628c97159 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:16.762761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bdec94ea-2729-43a5-b686-de0628c97159 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:16.773497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bdec94ea-2729-43a5-b686-de0628c97159 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:16.774220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bdec94ea-2729-43a5-b686-de0628c97159 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:16.775249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bdec94ea-2729-43a5-b686-de0628c97159 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:16.775669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bdec94ea-2729-43a5-b686-de0628c97159 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:16.835733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bdec94ea-2729-43a5-b686-de0628c97159 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:16.843302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bdec94ea-2729-43a5-b686-de0628c97159 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087618 Feb 21 01:00:16.843855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 609/1034] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:17.863116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-182ab393-454e-46e3-834a-5ee7bdaf6ead tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:17.863984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-182ab393-454e-46e3-834a-5ee7bdaf6ead tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:17.872560 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-182ab393-454e-46e3-834a-5ee7bdaf6ead tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:17.873004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-182ab393-454e-46e3-834a-5ee7bdaf6ead tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:17.873771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-182ab393-454e-46e3-834a-5ee7bdaf6ead tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:17.874198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-182ab393-454e-46e3-834a-5ee7bdaf6ead tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:17.936235 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-182ab393-454e-46e3-834a-5ee7bdaf6ead tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:17.943687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-182ab393-454e-46e3-834a-5ee7bdaf6ead tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086757 Feb 21 01:00:17.944238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 426/1035] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:17 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:18.961561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f18411a2-e237-41a5-840a-5cf48b40924d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:18.962120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f18411a2-e237-41a5-840a-5cf48b40924d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:18.968850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f18411a2-e237-41a5-840a-5cf48b40924d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:18.969291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f18411a2-e237-41a5-840a-5cf48b40924d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:18.970068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f18411a2-e237-41a5-840a-5cf48b40924d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:18.970491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f18411a2-e237-41a5-840a-5cf48b40924d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:19.030833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f18411a2-e237-41a5-840a-5cf48b40924d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:19.038493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f18411a2-e237-41a5-840a-5cf48b40924d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.080822 Feb 21 01:00:19.039070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 610/1036] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:18 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:20.057964 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ca45cea7-6f72-4599-bf3e-0ae6476a2aac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:20.058810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ca45cea7-6f72-4599-bf3e-0ae6476a2aac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:20.066795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ca45cea7-6f72-4599-bf3e-0ae6476a2aac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:20.067315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ca45cea7-6f72-4599-bf3e-0ae6476a2aac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:20.068314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ca45cea7-6f72-4599-bf3e-0ae6476a2aac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:20.068894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ca45cea7-6f72-4599-bf3e-0ae6476a2aac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:20.132421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ca45cea7-6f72-4599-bf3e-0ae6476a2aac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:20.140280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ca45cea7-6f72-4599-bf3e-0ae6476a2aac tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087930 Feb 21 01:00:20.140863 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 427/1037] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:20 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:21.161456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-792c3ccc-e812-412d-be88-05c5fcfd68b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:21.162480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-792c3ccc-e812-412d-be88-05c5fcfd68b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:21.170207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-792c3ccc-e812-412d-be88-05c5fcfd68b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:21.170651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-792c3ccc-e812-412d-be88-05c5fcfd68b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:21.171422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-792c3ccc-e812-412d-be88-05c5fcfd68b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:21.171849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-792c3ccc-e812-412d-be88-05c5fcfd68b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:21.238434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-792c3ccc-e812-412d-be88-05c5fcfd68b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:21.246764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-792c3ccc-e812-412d-be88-05c5fcfd68b2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091303 Feb 21 01:00:21.247765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 611/1038] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:21 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:22.268006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b7c1fe5d-821b-4593-9b98-e80b52e99034 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:22.269032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b7c1fe5d-821b-4593-9b98-e80b52e99034 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:22.277749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7c1fe5d-821b-4593-9b98-e80b52e99034 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:22.278196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7c1fe5d-821b-4593-9b98-e80b52e99034 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:22.279294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7c1fe5d-821b-4593-9b98-e80b52e99034 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:22.279729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7c1fe5d-821b-4593-9b98-e80b52e99034 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:22.340979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b7c1fe5d-821b-4593-9b98-e80b52e99034 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:22.349048 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b7c1fe5d-821b-4593-9b98-e80b52e99034 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087176 Feb 21 01:00:22.349610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 428/1039] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:22 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:23.368593 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-13d7d68f-5839-4397-8c94-b5246eeca9a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:23.369191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-13d7d68f-5839-4397-8c94-b5246eeca9a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:23.378751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-13d7d68f-5839-4397-8c94-b5246eeca9a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:23.379341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-13d7d68f-5839-4397-8c94-b5246eeca9a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:23.380486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-13d7d68f-5839-4397-8c94-b5246eeca9a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:23.381019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-13d7d68f-5839-4397-8c94-b5246eeca9a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:23.447003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-13d7d68f-5839-4397-8c94-b5246eeca9a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:23.454564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-13d7d68f-5839-4397-8c94-b5246eeca9a3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091842 Feb 21 01:00:23.455162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 612/1040] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:23 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:24.475067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5ccbedb2-e04e-4084-bf56-839511e840f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:24.476139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5ccbedb2-e04e-4084-bf56-839511e840f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:24.486534 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ccbedb2-e04e-4084-bf56-839511e840f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:24.487263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ccbedb2-e04e-4084-bf56-839511e840f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:24.488583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ccbedb2-e04e-4084-bf56-839511e840f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:24.489292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ccbedb2-e04e-4084-bf56-839511e840f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:24.554424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5ccbedb2-e04e-4084-bf56-839511e840f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:24.561993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5ccbedb2-e04e-4084-bf56-839511e840f0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093212 Feb 21 01:00:24.562553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 429/1041] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:24 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:25.582690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6fbdd2c1-e7f7-4fcd-944d-17f877a2e377 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:25.583690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6fbdd2c1-e7f7-4fcd-944d-17f877a2e377 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:25.594253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6fbdd2c1-e7f7-4fcd-944d-17f877a2e377 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:25.594973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6fbdd2c1-e7f7-4fcd-944d-17f877a2e377 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:25.596245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6fbdd2c1-e7f7-4fcd-944d-17f877a2e377 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:25.597043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6fbdd2c1-e7f7-4fcd-944d-17f877a2e377 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:25.665784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6fbdd2c1-e7f7-4fcd-944d-17f877a2e377 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:25.673354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6fbdd2c1-e7f7-4fcd-944d-17f877a2e377 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096867 Feb 21 01:00:25.673915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 613/1042] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:25 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:26.696142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7437f282-1807-48cc-886a-a2b2cef15322 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:26.699367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7437f282-1807-48cc-886a-a2b2cef15322 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:26.710458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7437f282-1807-48cc-886a-a2b2cef15322 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:26.711043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7437f282-1807-48cc-886a-a2b2cef15322 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:26.712119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7437f282-1807-48cc-886a-a2b2cef15322 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:26.712768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7437f282-1807-48cc-886a-a2b2cef15322 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:26.773132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7437f282-1807-48cc-886a-a2b2cef15322 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:26.781528 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7437f282-1807-48cc-886a-a2b2cef15322 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094137 Feb 21 01:00:26.782114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 430/1043] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:27.888161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-950f3417-9577-4777-8a2f-fd4ef14174bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:27.888824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-950f3417-9577-4777-8a2f-fd4ef14174bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:27.895362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-950f3417-9577-4777-8a2f-fd4ef14174bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:27.895798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-950f3417-9577-4777-8a2f-fd4ef14174bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:27.896607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-950f3417-9577-4777-8a2f-fd4ef14174bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:27.897034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-950f3417-9577-4777-8a2f-fd4ef14174bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:27.958576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-950f3417-9577-4777-8a2f-fd4ef14174bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:27.970413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-950f3417-9577-4777-8a2f-fd4ef14174bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.174007 Feb 21 01:00:27.971214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 614/1044] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:28.990599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0a179b6a-20cc-49b4-9bdb-62621156a168 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:28.991571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0a179b6a-20cc-49b4-9bdb-62621156a168 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:29.000259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0a179b6a-20cc-49b4-9bdb-62621156a168 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:29.000888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0a179b6a-20cc-49b4-9bdb-62621156a168 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:29.002046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0a179b6a-20cc-49b4-9bdb-62621156a168 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:29.002625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0a179b6a-20cc-49b4-9bdb-62621156a168 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:29.070797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0a179b6a-20cc-49b4-9bdb-62621156a168 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:29.078385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0a179b6a-20cc-49b4-9bdb-62621156a168 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093953 Feb 21 01:00:29.078951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 431/1045] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:28 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:30.099172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2467558f-1f60-49ae-a911-a78feb858264 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:30.100152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2467558f-1f60-49ae-a911-a78feb858264 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:30.109033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2467558f-1f60-49ae-a911-a78feb858264 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:30.109482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2467558f-1f60-49ae-a911-a78feb858264 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:30.110304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2467558f-1f60-49ae-a911-a78feb858264 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:30.110850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2467558f-1f60-49ae-a911-a78feb858264 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:30.172175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2467558f-1f60-49ae-a911-a78feb858264 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:30.180241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2467558f-1f60-49ae-a911-a78feb858264 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087297 Feb 21 01:00:30.180846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 615/1046] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:30 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:31.206475 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-987e471b-9100-422e-8ea4-67b311778a54 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:31.207488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-987e471b-9100-422e-8ea4-67b311778a54 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:31.216554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-987e471b-9100-422e-8ea4-67b311778a54 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:31.217000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-987e471b-9100-422e-8ea4-67b311778a54 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:31.217776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-987e471b-9100-422e-8ea4-67b311778a54 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:31.218228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-987e471b-9100-422e-8ea4-67b311778a54 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:31.278129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-987e471b-9100-422e-8ea4-67b311778a54 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:31.286012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-987e471b-9100-422e-8ea4-67b311778a54 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085665 Feb 21 01:00:31.286567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 432/1047] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:31 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:32.306804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-67154665-f3d4-47e7-b1a2-433addb1716b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:32.307757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-67154665-f3d4-47e7-b1a2-433addb1716b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:32.318423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67154665-f3d4-47e7-b1a2-433addb1716b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:32.319229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67154665-f3d4-47e7-b1a2-433addb1716b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:32.320555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67154665-f3d4-47e7-b1a2-433addb1716b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:32.321274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-67154665-f3d4-47e7-b1a2-433addb1716b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:32.390562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-67154665-f3d4-47e7-b1a2-433addb1716b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:32.398583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-67154665-f3d4-47e7-b1a2-433addb1716b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097948 Feb 21 01:00:32.399155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 616/1048] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:32 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:33.415907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fdf4041d-ac0a-4e82-9582-416aa94725db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:33.416523 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fdf4041d-ac0a-4e82-9582-416aa94725db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:33.423120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fdf4041d-ac0a-4e82-9582-416aa94725db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:33.423567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fdf4041d-ac0a-4e82-9582-416aa94725db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:33.424333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fdf4041d-ac0a-4e82-9582-416aa94725db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:33.424791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fdf4041d-ac0a-4e82-9582-416aa94725db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:33.484134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fdf4041d-ac0a-4e82-9582-416aa94725db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:33.495172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fdf4041d-ac0a-4e82-9582-416aa94725db tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.082581 Feb 21 01:00:33.495736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 433/1049] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:33 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:34.514728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e82fca55-0aea-44c4-9c73-002b00b7196a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:34.515412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e82fca55-0aea-44c4-9c73-002b00b7196a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:34.523758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e82fca55-0aea-44c4-9c73-002b00b7196a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:34.524305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e82fca55-0aea-44c4-9c73-002b00b7196a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:34.525400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e82fca55-0aea-44c4-9c73-002b00b7196a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:34.525928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e82fca55-0aea-44c4-9c73-002b00b7196a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:34.588456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e82fca55-0aea-44c4-9c73-002b00b7196a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:34.595923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e82fca55-0aea-44c4-9c73-002b00b7196a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086292 Feb 21 01:00:34.596529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 617/1050] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:34 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:35.616645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d6a8045f-27c8-4ea1-9375-479db727454a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:35.617664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d6a8045f-27c8-4ea1-9375-479db727454a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:35.628295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d6a8045f-27c8-4ea1-9375-479db727454a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:35.629070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d6a8045f-27c8-4ea1-9375-479db727454a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:35.630391 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d6a8045f-27c8-4ea1-9375-479db727454a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:35.631089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d6a8045f-27c8-4ea1-9375-479db727454a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:35.700884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d6a8045f-27c8-4ea1-9375-479db727454a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:35.708732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d6a8045f-27c8-4ea1-9375-479db727454a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.098420 Feb 21 01:00:35.709273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 434/1051] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:35 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:36.545070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-13a506b4-3c11-4db6-bf21-c288e5f2f29b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:36.545584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-13a506b4-3c11-4db6-bf21-c288e5f2f29b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:36.552166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-13a506b4-3c11-4db6-bf21-c288e5f2f29b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:36.552650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-13a506b4-3c11-4db6-bf21-c288e5f2f29b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:36.553429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-13a506b4-3c11-4db6-bf21-c288e5f2f29b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:36.553861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-13a506b4-3c11-4db6-bf21-c288e5f2f29b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:36.578851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-13a506b4-3c11-4db6-bf21-c288e5f2f29b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Going to try to terminate instance {{(pid=123098) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:00:36.655874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-13a506b4-3c11-4db6-bf21-c288e5f2f29b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 204 len: 0 microversion: 2.1 time: 0.175184 Feb 21 01:00:36.656505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 618/1052] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:00:36 2022] DELETE /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:00:36.664746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cce57c3c-c0c0-4938-8a77-7d0f2004be0d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:36.665364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cce57c3c-c0c0-4938-8a77-7d0f2004be0d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:36.671643 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cce57c3c-c0c0-4938-8a77-7d0f2004be0d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:36.672092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cce57c3c-c0c0-4938-8a77-7d0f2004be0d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:36.672896 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cce57c3c-c0c0-4938-8a77-7d0f2004be0d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:36.673331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cce57c3c-c0c0-4938-8a77-7d0f2004be0d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:36.726127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-39440905-0d0b-4de7-8479-bf299848df1d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:36.726838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-39440905-0d0b-4de7-8479-bf299848df1d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:36.733381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39440905-0d0b-4de7-8479-bf299848df1d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:36.733958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39440905-0d0b-4de7-8479-bf299848df1d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:36.734644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39440905-0d0b-4de7-8479-bf299848df1d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:36.735115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-39440905-0d0b-4de7-8479-bf299848df1d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:36.799622 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-39440905-0d0b-4de7-8479-bf299848df1d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:36.806959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-39440905-0d0b-4de7-8479-bf299848df1d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084937 Feb 21 01:00:36.807537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 619/1053] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:36 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:36.813574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cce57c3c-c0c0-4938-8a77-7d0f2004be0d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:36.821351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cce57c3c-c0c0-4938-8a77-7d0f2004be0d tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1672 microversion: 2.1 time: 0.160418 Feb 21 01:00:36.821904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 435/1054] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:36 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:37.827565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d9d8304e-4ed1-42bc-b95d-99f71c8bfd55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:37.828473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d9d8304e-4ed1-42bc-b95d-99f71c8bfd55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:37.839026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d9d8304e-4ed1-42bc-b95d-99f71c8bfd55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:37.839780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d9d8304e-4ed1-42bc-b95d-99f71c8bfd55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:37.841108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d9d8304e-4ed1-42bc-b95d-99f71c8bfd55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:37.842148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d9d8304e-4ed1-42bc-b95d-99f71c8bfd55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:37.842853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b4b8b2a1-7f50-4200-b877-ed1e4aaf3812 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:37.843527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b4b8b2a1-7f50-4200-b877-ed1e4aaf3812 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:37.853611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b8b2a1-7f50-4200-b877-ed1e4aaf3812 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:37.854327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b8b2a1-7f50-4200-b877-ed1e4aaf3812 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:37.855108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b8b2a1-7f50-4200-b877-ed1e4aaf3812 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:37.855538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b8b2a1-7f50-4200-b877-ed1e4aaf3812 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:37.907185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d9d8304e-4ed1-42bc-b95d-99f71c8bfd55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:37.915010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d9d8304e-4ed1-42bc-b95d-99f71c8bfd55 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093701 Feb 21 01:00:37.915555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 620/1055] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:37.985065 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b4b8b2a1-7f50-4200-b877-ed1e4aaf3812 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:37.992783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b4b8b2a1-7f50-4200-b877-ed1e4aaf3812 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1672 microversion: 2.1 time: 0.156516 Feb 21 01:00:37.993329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 436/1056] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:37 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:38.932419 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e5941df7-92e2-4a8d-9319-c232524cfc2a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:38.933069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e5941df7-92e2-4a8d-9319-c232524cfc2a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:38.939819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e5941df7-92e2-4a8d-9319-c232524cfc2a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:38.940284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e5941df7-92e2-4a8d-9319-c232524cfc2a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:38.941060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e5941df7-92e2-4a8d-9319-c232524cfc2a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:38.941487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e5941df7-92e2-4a8d-9319-c232524cfc2a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:39.003195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e5941df7-92e2-4a8d-9319-c232524cfc2a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:39.010673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-80e7313e-6ec1-4e8f-86eb-0c1a6078c590 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:39.011331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-80e7313e-6ec1-4e8f-86eb-0c1a6078c590 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:39.012000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e5941df7-92e2-4a8d-9319-c232524cfc2a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083798 Feb 21 01:00:39.012595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 621/1057] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:38 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:39.027154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-80e7313e-6ec1-4e8f-86eb-0c1a6078c590 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:39.027664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-80e7313e-6ec1-4e8f-86eb-0c1a6078c590 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:39.028861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-80e7313e-6ec1-4e8f-86eb-0c1a6078c590 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:39.029354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-80e7313e-6ec1-4e8f-86eb-0c1a6078c590 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:39.096137 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-80e7313e-6ec1-4e8f-86eb-0c1a6078c590 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb4137c17e343e3a8d91ba801ecfbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e2484e716a4d078e8314885525ee23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:39.103493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-80e7313e-6ec1-4e8f-86eb-0c1a6078c590 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 200 len: 1606 microversion: 2.1 time: 0.097196 Feb 21 01:00:39.104147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 437/1058] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:39 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 1606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:39.419099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-ee14edb4-4d18-4a66-b4c5-53a52b8decea req-caeea0c7-f5e1-4e47-9435-dc44767601b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e", "name": "network-vif-deleted", "tag": "9e7311a4-291e-4b74-acef-de7ecb911272"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:00:39.420687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:00:39.420687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:00:39.427661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-ee14edb4-4d18-4a66-b4c5-53a52b8decea req-caeea0c7-f5e1-4e47-9435-dc44767601b8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:39.428316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-ee14edb4-4d18-4a66-b4c5-53a52b8decea req-caeea0c7-f5e1-4e47-9435-dc44767601b8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:39.440737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-ee14edb4-4d18-4a66-b4c5-53a52b8decea req-caeea0c7-f5e1-4e47-9435-dc44767601b8 service nova] Creating event network-vif-deleted:9e7311a4-291e-4b74-acef-de7ecb911272 for instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e on hv-cinder-81322 Feb 21 01:00:39.446003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-ee14edb4-4d18-4a66-b4c5-53a52b8decea req-caeea0c7-f5e1-4e47-9435-dc44767601b8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030530 Feb 21 01:00:39.447296 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 622/1059] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:00:40.029079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-19b11526-bc48-4e75-80f6-22dd317f3a5d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:40.029687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-19b11526-bc48-4e75-80f6-22dd317f3a5d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:40.036092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19b11526-bc48-4e75-80f6-22dd317f3a5d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:40.036590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19b11526-bc48-4e75-80f6-22dd317f3a5d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:40.037382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19b11526-bc48-4e75-80f6-22dd317f3a5d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:40.037909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19b11526-bc48-4e75-80f6-22dd317f3a5d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:40.101485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19b11526-bc48-4e75-80f6-22dd317f3a5d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:40.109425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-19b11526-bc48-4e75-80f6-22dd317f3a5d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084324 Feb 21 01:00:40.110025 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 438/1060] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:40 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:40.121996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:40.122782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:40.129388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:40.129880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:40.130719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:40.131261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:40.145494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] HTTP exception thrown: Instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e could not be found. Feb 21 01:00:40.146120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Returning 404 to user: Instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:00:40.147141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-beef0a03-2c08-4980-9ad7-4c8a9c62785e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 404 len: 111 microversion: 2.1 time: 0.029672 Feb 21 01:00:40.147644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 623/1061] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:40 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:00:40.156298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-13cf3af6-85ab-4b3b-88b5-3959d26ada48 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '.version_select at 0x7fe56d292f70>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:40.175678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-13cf3af6-85ab-4b3b-88b5-3959d26ada48 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205520788" status: 202 len: 0 microversion: 2.1 time: 0.023257 Feb 21 01:00:40.176346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 439/1062] 10.222.0.72 () {58 vars in 1220 bytes} [Mon Feb 21 01:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205520788 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:00:40.809337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:40.809758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:40.816122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:40.816603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:40.817374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:40.817798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:40.831164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] HTTP exception thrown: Instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e could not be found. Feb 21 01:00:40.831816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Returning 404 to user: Instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:00:40.832660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f8e68581-24e5-4a3a-a665-869836dae42b tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 404 len: 111 microversion: 2.1 time: 0.027220 Feb 21 01:00:40.833170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 624/1063] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:00:40 2022] DELETE /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:00:40.841198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:40.841814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:40.848367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:40.848854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:40.849630 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:40.850059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:40.873028 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] HTTP exception thrown: Instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e could not be found. Feb 21 01:00:40.873652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Returning 404 to user: Instance f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:00:40.874509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c2c652ae-d3a9-4093-8a6b-ff258008e8d0 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e" status: 404 len: 111 microversion: 2.1 time: 0.037104 Feb 21 01:00:40.875068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 440/1064] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:40 2022] GET /compute/v2.1/servers/f2a8ffb3-aca5-49ac-867b-e8a12eb6c83e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:00:41.130671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-673adaf4-9b2f-4cbc-8a1e-791f1f328647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:41.131527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-673adaf4-9b2f-4cbc-8a1e-791f1f328647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:41.142323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-673adaf4-9b2f-4cbc-8a1e-791f1f328647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:41.143062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-673adaf4-9b2f-4cbc-8a1e-791f1f328647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:41.144337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-673adaf4-9b2f-4cbc-8a1e-791f1f328647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:41.145108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-673adaf4-9b2f-4cbc-8a1e-791f1f328647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:41.209359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-673adaf4-9b2f-4cbc-8a1e-791f1f328647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:41.217152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-673adaf4-9b2f-4cbc-8a1e-791f1f328647 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093167 Feb 21 01:00:41.217720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 625/1065] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:42.238041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0b09e1ff-5fe3-40ea-b773-0e4d43655343 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:42.238974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0b09e1ff-5fe3-40ea-b773-0e4d43655343 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:42.249643 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b09e1ff-5fe3-40ea-b773-0e4d43655343 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:42.250382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b09e1ff-5fe3-40ea-b773-0e4d43655343 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:42.251643 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b09e1ff-5fe3-40ea-b773-0e4d43655343 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:42.252363 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b09e1ff-5fe3-40ea-b773-0e4d43655343 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:42.319106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0b09e1ff-5fe3-40ea-b773-0e4d43655343 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:42.327073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0b09e1ff-5fe3-40ea-b773-0e4d43655343 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095289 Feb 21 01:00:42.327665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 441/1066] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:42 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:43.344493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3a54494c-6947-4916-af67-9de9d5c95cc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:43.345200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3a54494c-6947-4916-af67-9de9d5c95cc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:43.352206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3a54494c-6947-4916-af67-9de9d5c95cc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:43.352668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3a54494c-6947-4916-af67-9de9d5c95cc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:43.353442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3a54494c-6947-4916-af67-9de9d5c95cc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:43.353898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3a54494c-6947-4916-af67-9de9d5c95cc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:43.413923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3a54494c-6947-4916-af67-9de9d5c95cc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:43.421315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3a54494c-6947-4916-af67-9de9d5c95cc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.080650 Feb 21 01:00:43.421871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 626/1067] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:43 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:44.439692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fc95af01-4002-4880-a3e9-482a409ac8a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:44.440291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fc95af01-4002-4880-a3e9-482a409ac8a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:44.447205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fc95af01-4002-4880-a3e9-482a409ac8a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:44.447695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fc95af01-4002-4880-a3e9-482a409ac8a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:44.448510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fc95af01-4002-4880-a3e9-482a409ac8a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:44.448938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fc95af01-4002-4880-a3e9-482a409ac8a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:44.526541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fc95af01-4002-4880-a3e9-482a409ac8a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:44.536107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fc95af01-4002-4880-a3e9-482a409ac8a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100101 Feb 21 01:00:44.536760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 442/1068] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:44 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:45.558291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-acdc73ae-6930-46fe-b57f-d6b9efc99445 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:45.558930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-acdc73ae-6930-46fe-b57f-d6b9efc99445 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:45.565722 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acdc73ae-6930-46fe-b57f-d6b9efc99445 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:45.566189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acdc73ae-6930-46fe-b57f-d6b9efc99445 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:45.566975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acdc73ae-6930-46fe-b57f-d6b9efc99445 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:45.567405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acdc73ae-6930-46fe-b57f-d6b9efc99445 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:45.638399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-acdc73ae-6930-46fe-b57f-d6b9efc99445 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:45.646803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-acdc73ae-6930-46fe-b57f-d6b9efc99445 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094389 Feb 21 01:00:45.647370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 627/1069] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:45 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:46.668651 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0791465c-a141-49da-b44a-a82fd142d02b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:46.669237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0791465c-a141-49da-b44a-a82fd142d02b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:46.676206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0791465c-a141-49da-b44a-a82fd142d02b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:46.676702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0791465c-a141-49da-b44a-a82fd142d02b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:46.677527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0791465c-a141-49da-b44a-a82fd142d02b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:46.677980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0791465c-a141-49da-b44a-a82fd142d02b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:46.747111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0791465c-a141-49da-b44a-a82fd142d02b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:46.754753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0791465c-a141-49da-b44a-a82fd142d02b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091594 Feb 21 01:00:46.755320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 443/1070] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:46 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:47.776068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d191ca63-3b8f-4d13-bc7d-3eb989657cbc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:47.776827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d191ca63-3b8f-4d13-bc7d-3eb989657cbc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:47.785204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d191ca63-3b8f-4d13-bc7d-3eb989657cbc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:47.785662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d191ca63-3b8f-4d13-bc7d-3eb989657cbc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:47.786578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d191ca63-3b8f-4d13-bc7d-3eb989657cbc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:47.787087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d191ca63-3b8f-4d13-bc7d-3eb989657cbc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:47.851507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d191ca63-3b8f-4d13-bc7d-3eb989657cbc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:47.859589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d191ca63-3b8f-4d13-bc7d-3eb989657cbc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090067 Feb 21 01:00:47.860180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 628/1071] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:48.880926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e76311c0-f0f1-4c05-9481-f0e5d3fd3bf3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:48.881823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e76311c0-f0f1-4c05-9481-f0e5d3fd3bf3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:48.890508 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e76311c0-f0f1-4c05-9481-f0e5d3fd3bf3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:48.890952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e76311c0-f0f1-4c05-9481-f0e5d3fd3bf3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:48.891714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e76311c0-f0f1-4c05-9481-f0e5d3fd3bf3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:48.892135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e76311c0-f0f1-4c05-9481-f0e5d3fd3bf3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:48.960420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e76311c0-f0f1-4c05-9481-f0e5d3fd3bf3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:48.968468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e76311c0-f0f1-4c05-9481-f0e5d3fd3bf3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094009 Feb 21 01:00:48.969031 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 444/1072] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:48 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:49.993819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-770585d2-eb57-413d-83aa-87d3f25ead37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:49.994950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-770585d2-eb57-413d-83aa-87d3f25ead37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:50.002210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-770585d2-eb57-413d-83aa-87d3f25ead37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:50.002653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-770585d2-eb57-413d-83aa-87d3f25ead37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:50.003426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-770585d2-eb57-413d-83aa-87d3f25ead37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:50.003852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-770585d2-eb57-413d-83aa-87d3f25ead37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:50.064748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-770585d2-eb57-413d-83aa-87d3f25ead37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:50.072660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-770585d2-eb57-413d-83aa-87d3f25ead37 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084973 Feb 21 01:00:50.073216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 629/1073] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:49 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:51.093291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f116ed49-c438-4d2a-a30d-df29f3e7d763 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:51.094336 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f116ed49-c438-4d2a-a30d-df29f3e7d763 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:51.104999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f116ed49-c438-4d2a-a30d-df29f3e7d763 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:51.105728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f116ed49-c438-4d2a-a30d-df29f3e7d763 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:51.106501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f116ed49-c438-4d2a-a30d-df29f3e7d763 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:51.106926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f116ed49-c438-4d2a-a30d-df29f3e7d763 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:51.167787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f116ed49-c438-4d2a-a30d-df29f3e7d763 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:51.176731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f116ed49-c438-4d2a-a30d-df29f3e7d763 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089644 Feb 21 01:00:51.177294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 445/1074] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:52.197663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b6afb5a1-b302-404d-9c1e-a9b7334aea44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:52.198721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b6afb5a1-b302-404d-9c1e-a9b7334aea44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:52.209461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6afb5a1-b302-404d-9c1e-a9b7334aea44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:52.210194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6afb5a1-b302-404d-9c1e-a9b7334aea44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:52.211465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6afb5a1-b302-404d-9c1e-a9b7334aea44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:52.212162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6afb5a1-b302-404d-9c1e-a9b7334aea44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:52.276114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b6afb5a1-b302-404d-9c1e-a9b7334aea44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:52.284841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b6afb5a1-b302-404d-9c1e-a9b7334aea44 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093488 Feb 21 01:00:52.285423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 630/1075] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:53.310180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cc683af0-824c-45c9-adfb-1a81a6b32090 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:53.311077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cc683af0-824c-45c9-adfb-1a81a6b32090 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:53.321733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cc683af0-824c-45c9-adfb-1a81a6b32090 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:53.322440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cc683af0-824c-45c9-adfb-1a81a6b32090 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:53.323829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cc683af0-824c-45c9-adfb-1a81a6b32090 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:53.324495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cc683af0-824c-45c9-adfb-1a81a6b32090 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:53.394440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cc683af0-824c-45c9-adfb-1a81a6b32090 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:53.402190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cc683af0-824c-45c9-adfb-1a81a6b32090 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.098863 Feb 21 01:00:53.402755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 446/1076] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:53 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:54.421805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5350ebcd-1845-4dcb-91cb-ba911e6a6922 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:54.422506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5350ebcd-1845-4dcb-91cb-ba911e6a6922 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:54.430289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5350ebcd-1845-4dcb-91cb-ba911e6a6922 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:54.430804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5350ebcd-1845-4dcb-91cb-ba911e6a6922 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:54.431702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5350ebcd-1845-4dcb-91cb-ba911e6a6922 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:54.432181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5350ebcd-1845-4dcb-91cb-ba911e6a6922 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:54.494461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5350ebcd-1845-4dcb-91cb-ba911e6a6922 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:54.502694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5350ebcd-1845-4dcb-91cb-ba911e6a6922 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086293 Feb 21 01:00:54.503273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 631/1077] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:54 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:55.523505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3f1c63c0-cb20-48df-90bf-c79aa7b4bf3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:55.524610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3f1c63c0-cb20-48df-90bf-c79aa7b4bf3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:55.535646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f1c63c0-cb20-48df-90bf-c79aa7b4bf3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:55.536368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f1c63c0-cb20-48df-90bf-c79aa7b4bf3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:55.537862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f1c63c0-cb20-48df-90bf-c79aa7b4bf3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:55.538578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f1c63c0-cb20-48df-90bf-c79aa7b4bf3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:55.602637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3f1c63c0-cb20-48df-90bf-c79aa7b4bf3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:55.610538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3f1c63c0-cb20-48df-90bf-c79aa7b4bf3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093189 Feb 21 01:00:55.611106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 447/1078] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:56.637089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2273bc64-6e64-4a0b-bdec-5d16697981c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:56.639054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2273bc64-6e64-4a0b-bdec-5d16697981c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:56.654357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2273bc64-6e64-4a0b-bdec-5d16697981c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:56.655085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2273bc64-6e64-4a0b-bdec-5d16697981c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:56.656186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2273bc64-6e64-4a0b-bdec-5d16697981c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:56.656646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2273bc64-6e64-4a0b-bdec-5d16697981c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:56.726796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2273bc64-6e64-4a0b-bdec-5d16697981c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:56.735141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2273bc64-6e64-4a0b-bdec-5d16697981c0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.109896 Feb 21 01:00:56.735710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 632/1079] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:57.752259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fd0fdeb7-6b8c-4401-a435-a517f3d9cc86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:57.752929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fd0fdeb7-6b8c-4401-a435-a517f3d9cc86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:57.759518 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fd0fdeb7-6b8c-4401-a435-a517f3d9cc86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:57.759968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fd0fdeb7-6b8c-4401-a435-a517f3d9cc86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:57.760808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fd0fdeb7-6b8c-4401-a435-a517f3d9cc86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:57.761239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fd0fdeb7-6b8c-4401-a435-a517f3d9cc86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:57.823539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fd0fdeb7-6b8c-4401-a435-a517f3d9cc86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:57.831935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fd0fdeb7-6b8c-4401-a435-a517f3d9cc86 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083507 Feb 21 01:00:57.832545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 448/1080] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:00:58.853085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e51261af-af41-493b-bd70-02eb08eec909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:00:58.854059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e51261af-af41-493b-bd70-02eb08eec909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:00:58.864122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e51261af-af41-493b-bd70-02eb08eec909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:58.865068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e51261af-af41-493b-bd70-02eb08eec909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:58.866200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e51261af-af41-493b-bd70-02eb08eec909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:00:58.866918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e51261af-af41-493b-bd70-02eb08eec909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:00:59.186626 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e51261af-af41-493b-bd70-02eb08eec909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:00:59.198486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e51261af-af41-493b-bd70-02eb08eec909 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.351629 Feb 21 01:00:59.199278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 633/1081] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:00:58 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:00.221527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8962daa6-92e0-4f22-b814-ae650c979110 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:00.222494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8962daa6-92e0-4f22-b814-ae650c979110 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:00.232621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8962daa6-92e0-4f22-b814-ae650c979110 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:00.233356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8962daa6-92e0-4f22-b814-ae650c979110 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:00.234498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8962daa6-92e0-4f22-b814-ae650c979110 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:00.234922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8962daa6-92e0-4f22-b814-ae650c979110 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:00.298118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8962daa6-92e0-4f22-b814-ae650c979110 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:00.306185 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8962daa6-92e0-4f22-b814-ae650c979110 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091724 Feb 21 01:01:00.306716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 449/1082] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:01.327627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-942f1ca3-201f-45c2-9288-2a6e61b9e849 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:01.328936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-942f1ca3-201f-45c2-9288-2a6e61b9e849 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:01.339404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-942f1ca3-201f-45c2-9288-2a6e61b9e849 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:01.340136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-942f1ca3-201f-45c2-9288-2a6e61b9e849 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:01.341451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-942f1ca3-201f-45c2-9288-2a6e61b9e849 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:01.342156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-942f1ca3-201f-45c2-9288-2a6e61b9e849 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:01.403032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-942f1ca3-201f-45c2-9288-2a6e61b9e849 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:01.414731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-942f1ca3-201f-45c2-9288-2a6e61b9e849 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092999 Feb 21 01:01:01.415528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 634/1083] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:01 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:02.437551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3396ecb4-5337-4eae-a5ec-b449488b80cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:02.438646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3396ecb4-5337-4eae-a5ec-b449488b80cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:02.449271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3396ecb4-5337-4eae-a5ec-b449488b80cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:02.450024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3396ecb4-5337-4eae-a5ec-b449488b80cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:02.451299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3396ecb4-5337-4eae-a5ec-b449488b80cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:02.452044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3396ecb4-5337-4eae-a5ec-b449488b80cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:02.512837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3396ecb4-5337-4eae-a5ec-b449488b80cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:02.520836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3396ecb4-5337-4eae-a5ec-b449488b80cd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089595 Feb 21 01:01:02.521399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 450/1084] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:03.544349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-06a0b5fe-da9c-418b-aace-c5ea32d13819 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:03.545416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-06a0b5fe-da9c-418b-aace-c5ea32d13819 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:03.553758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06a0b5fe-da9c-418b-aace-c5ea32d13819 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:03.554200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06a0b5fe-da9c-418b-aace-c5ea32d13819 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:03.554981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06a0b5fe-da9c-418b-aace-c5ea32d13819 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:03.555412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06a0b5fe-da9c-418b-aace-c5ea32d13819 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:03.615837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-06a0b5fe-da9c-418b-aace-c5ea32d13819 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:03.623418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-06a0b5fe-da9c-418b-aace-c5ea32d13819 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085245 Feb 21 01:01:03.624016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 635/1085] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:03 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:04.643709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-21531701-8478-480b-8e79-f1802376d0e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:04.644822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-21531701-8478-480b-8e79-f1802376d0e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:04.655467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-21531701-8478-480b-8e79-f1802376d0e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:04.656202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-21531701-8478-480b-8e79-f1802376d0e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:04.657586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-21531701-8478-480b-8e79-f1802376d0e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:04.658300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-21531701-8478-480b-8e79-f1802376d0e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:04.718354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-21531701-8478-480b-8e79-f1802376d0e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:04.725949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-21531701-8478-480b-8e79-f1802376d0e5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088479 Feb 21 01:01:04.726519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 451/1086] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:04 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:05.746871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-208d4ff7-d1ac-40b1-b8cd-216f8410427c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:05.747952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-208d4ff7-d1ac-40b1-b8cd-216f8410427c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:05.758539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-208d4ff7-d1ac-40b1-b8cd-216f8410427c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:05.759275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-208d4ff7-d1ac-40b1-b8cd-216f8410427c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:05.760598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-208d4ff7-d1ac-40b1-b8cd-216f8410427c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:05.761317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-208d4ff7-d1ac-40b1-b8cd-216f8410427c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:05.824445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-208d4ff7-d1ac-40b1-b8cd-216f8410427c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:05.832286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-208d4ff7-d1ac-40b1-b8cd-216f8410427c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091760 Feb 21 01:01:05.832886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 636/1087] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:05 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:06.852576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c6803d28-1632-4b2e-843e-3acd77aab5e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:06.853499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c6803d28-1632-4b2e-843e-3acd77aab5e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:06.864294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6803d28-1632-4b2e-843e-3acd77aab5e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:06.865113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6803d28-1632-4b2e-843e-3acd77aab5e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:06.866494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6803d28-1632-4b2e-843e-3acd77aab5e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:06.867220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6803d28-1632-4b2e-843e-3acd77aab5e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:06.933368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c6803d28-1632-4b2e-843e-3acd77aab5e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:06.941070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c6803d28-1632-4b2e-843e-3acd77aab5e4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094889 Feb 21 01:01:06.941637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 452/1088] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:06 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:07.960731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6922980b-621a-4f7e-a1fa-dbffb3b1cacd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:07.961358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6922980b-621a-4f7e-a1fa-dbffb3b1cacd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:07.968907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6922980b-621a-4f7e-a1fa-dbffb3b1cacd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:07.969397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6922980b-621a-4f7e-a1fa-dbffb3b1cacd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:07.970258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6922980b-621a-4f7e-a1fa-dbffb3b1cacd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:07.970731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6922980b-621a-4f7e-a1fa-dbffb3b1cacd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:08.035386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6922980b-621a-4f7e-a1fa-dbffb3b1cacd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:08.043134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6922980b-621a-4f7e-a1fa-dbffb3b1cacd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087174 Feb 21 01:01:08.043706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 637/1089] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:07 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:09.065120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b1b2ac8c-59e3-4f69-b76d-04d51290dca2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:09.066075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b1b2ac8c-59e3-4f69-b76d-04d51290dca2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:09.073285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1b2ac8c-59e3-4f69-b76d-04d51290dca2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:09.073724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1b2ac8c-59e3-4f69-b76d-04d51290dca2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:09.074497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1b2ac8c-59e3-4f69-b76d-04d51290dca2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:09.074922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1b2ac8c-59e3-4f69-b76d-04d51290dca2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:09.140750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b1b2ac8c-59e3-4f69-b76d-04d51290dca2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:09.148966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b1b2ac8c-59e3-4f69-b76d-04d51290dca2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090293 Feb 21 01:01:09.149525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 453/1090] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:09 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:10.170344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e04798c1-46f8-4b06-b2ec-52a7b8fa806d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:10.171310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e04798c1-46f8-4b06-b2ec-52a7b8fa806d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:10.180528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e04798c1-46f8-4b06-b2ec-52a7b8fa806d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:10.180972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e04798c1-46f8-4b06-b2ec-52a7b8fa806d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:10.181750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e04798c1-46f8-4b06-b2ec-52a7b8fa806d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:10.182203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e04798c1-46f8-4b06-b2ec-52a7b8fa806d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:10.249074 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e04798c1-46f8-4b06-b2ec-52a7b8fa806d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:10.259499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e04798c1-46f8-4b06-b2ec-52a7b8fa806d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095065 Feb 21 01:01:10.260269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 638/1091] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:10 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:11.283641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-aeb4d916-5d0a-44f3-bea4-a16f65ad439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:11.284667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-aeb4d916-5d0a-44f3-bea4-a16f65ad439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:11.294790 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aeb4d916-5d0a-44f3-bea4-a16f65ad439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:11.295404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aeb4d916-5d0a-44f3-bea4-a16f65ad439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:11.296539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aeb4d916-5d0a-44f3-bea4-a16f65ad439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:11.297149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aeb4d916-5d0a-44f3-bea4-a16f65ad439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:11.364793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-aeb4d916-5d0a-44f3-bea4-a16f65ad439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:11.372157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-aeb4d916-5d0a-44f3-bea4-a16f65ad439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095175 Feb 21 01:01:11.372959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 454/1092] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:11 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:12.390316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7eb2edc5-e721-4117-8c84-59639ff4f8ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:12.390992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7eb2edc5-e721-4117-8c84-59639ff4f8ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:12.398133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb2edc5-e721-4117-8c84-59639ff4f8ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:12.398589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb2edc5-e721-4117-8c84-59639ff4f8ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:12.399405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb2edc5-e721-4117-8c84-59639ff4f8ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:12.399839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb2edc5-e721-4117-8c84-59639ff4f8ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:12.460940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7eb2edc5-e721-4117-8c84-59639ff4f8ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:12.468752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7eb2edc5-e721-4117-8c84-59639ff4f8ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.082327 Feb 21 01:01:12.469334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 639/1093] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:12 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:13.489567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dfba7e0f-b56a-4e81-851d-45f9a0a9992f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:13.490518 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dfba7e0f-b56a-4e81-851d-45f9a0a9992f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:13.501304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dfba7e0f-b56a-4e81-851d-45f9a0a9992f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:13.501923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dfba7e0f-b56a-4e81-851d-45f9a0a9992f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:13.503183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dfba7e0f-b56a-4e81-851d-45f9a0a9992f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:13.503898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dfba7e0f-b56a-4e81-851d-45f9a0a9992f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:13.569101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dfba7e0f-b56a-4e81-851d-45f9a0a9992f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:13.577265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dfba7e0f-b56a-4e81-851d-45f9a0a9992f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093826 Feb 21 01:01:13.577833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 455/1094] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:14.598287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-db48e85f-5d04-4809-924e-e0925c1b8f3e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:14.599289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-db48e85f-5d04-4809-924e-e0925c1b8f3e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:14.609932 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-db48e85f-5d04-4809-924e-e0925c1b8f3e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:14.610668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-db48e85f-5d04-4809-924e-e0925c1b8f3e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:14.611945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-db48e85f-5d04-4809-924e-e0925c1b8f3e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:14.612708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-db48e85f-5d04-4809-924e-e0925c1b8f3e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:14.675094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-db48e85f-5d04-4809-924e-e0925c1b8f3e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:14.684253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-db48e85f-5d04-4809-924e-e0925c1b8f3e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092341 Feb 21 01:01:14.684855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 640/1095] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:15.704974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-98ae23e2-96dc-428e-805a-c23f15a74000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:15.706080 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-98ae23e2-96dc-428e-805a-c23f15a74000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:15.716614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-98ae23e2-96dc-428e-805a-c23f15a74000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:15.717357 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-98ae23e2-96dc-428e-805a-c23f15a74000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:15.718638 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-98ae23e2-96dc-428e-805a-c23f15a74000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:15.719351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-98ae23e2-96dc-428e-805a-c23f15a74000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:15.781246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-98ae23e2-96dc-428e-805a-c23f15a74000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:15.788827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-98ae23e2-96dc-428e-805a-c23f15a74000 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090032 Feb 21 01:01:15.789387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 456/1096] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:16.809204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-af118633-4f1d-40f2-ba6f-25722b19ea9a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:16.810080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-af118633-4f1d-40f2-ba6f-25722b19ea9a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:16.820694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-af118633-4f1d-40f2-ba6f-25722b19ea9a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:16.821276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-af118633-4f1d-40f2-ba6f-25722b19ea9a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:16.822541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-af118633-4f1d-40f2-ba6f-25722b19ea9a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:16.823285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-af118633-4f1d-40f2-ba6f-25722b19ea9a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:16.896317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-af118633-4f1d-40f2-ba6f-25722b19ea9a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:16.904449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-af118633-4f1d-40f2-ba6f-25722b19ea9a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.101623 Feb 21 01:01:16.905053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 641/1097] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:17.925432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bb2bfb2d-8ae0-4c02-a5f1-045e7adde351 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:17.926286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bb2bfb2d-8ae0-4c02-a5f1-045e7adde351 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:17.937026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb2bfb2d-8ae0-4c02-a5f1-045e7adde351 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:17.937771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb2bfb2d-8ae0-4c02-a5f1-045e7adde351 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:17.939049 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb2bfb2d-8ae0-4c02-a5f1-045e7adde351 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:17.939758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb2bfb2d-8ae0-4c02-a5f1-045e7adde351 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:18.014142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bb2bfb2d-8ae0-4c02-a5f1-045e7adde351 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:18.022207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bb2bfb2d-8ae0-4c02-a5f1-045e7adde351 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.102945 Feb 21 01:01:18.022798 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 457/1098] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:17 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:19.048215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-10a61b34-d92e-4815-ada4-d47aa26f5139 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:19.049263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-10a61b34-d92e-4815-ada4-d47aa26f5139 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:19.057670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-10a61b34-d92e-4815-ada4-d47aa26f5139 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:19.058118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-10a61b34-d92e-4815-ada4-d47aa26f5139 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:19.058894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-10a61b34-d92e-4815-ada4-d47aa26f5139 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:19.059325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-10a61b34-d92e-4815-ada4-d47aa26f5139 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:19.128695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-10a61b34-d92e-4815-ada4-d47aa26f5139 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:19.137275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-10a61b34-d92e-4815-ada4-d47aa26f5139 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095252 Feb 21 01:01:19.137939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 642/1099] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:19 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:20.161589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a0620170-5c13-4e2f-904a-816a4144b716 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:20.162564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a0620170-5c13-4e2f-904a-816a4144b716 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:20.170148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0620170-5c13-4e2f-904a-816a4144b716 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:20.170635 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0620170-5c13-4e2f-904a-816a4144b716 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:20.171492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0620170-5c13-4e2f-904a-816a4144b716 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:20.172062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0620170-5c13-4e2f-904a-816a4144b716 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:20.239975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a0620170-5c13-4e2f-904a-816a4144b716 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:20.248063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a0620170-5c13-4e2f-904a-816a4144b716 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092821 Feb 21 01:01:20.248638 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 458/1100] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:20 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:21.268957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-758f8dcb-3333-47ff-afb9-d7bd82149bd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:21.269943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-758f8dcb-3333-47ff-afb9-d7bd82149bd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:21.277420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-758f8dcb-3333-47ff-afb9-d7bd82149bd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:21.277861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-758f8dcb-3333-47ff-afb9-d7bd82149bd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:21.278963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-758f8dcb-3333-47ff-afb9-d7bd82149bd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:21.279387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-758f8dcb-3333-47ff-afb9-d7bd82149bd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:21.338418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-758f8dcb-3333-47ff-afb9-d7bd82149bd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:21.345922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-758f8dcb-3333-47ff-afb9-d7bd82149bd1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083235 Feb 21 01:01:21.346490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 643/1101] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:21 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:22.367613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-05eff3e8-5d9f-4be4-bae0-38121a56e9c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:22.368648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-05eff3e8-5d9f-4be4-bae0-38121a56e9c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:22.379205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05eff3e8-5d9f-4be4-bae0-38121a56e9c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:22.379951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05eff3e8-5d9f-4be4-bae0-38121a56e9c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:22.381296 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05eff3e8-5d9f-4be4-bae0-38121a56e9c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:22.381894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05eff3e8-5d9f-4be4-bae0-38121a56e9c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:22.452544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-05eff3e8-5d9f-4be4-bae0-38121a56e9c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:22.460532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-05eff3e8-5d9f-4be4-bae0-38121a56e9c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.099594 Feb 21 01:01:22.461103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 459/1102] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:22 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:23.479381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4909a524-6364-4c5f-ad7d-1ed41f199c5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:23.480164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4909a524-6364-4c5f-ad7d-1ed41f199c5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:23.488776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4909a524-6364-4c5f-ad7d-1ed41f199c5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:23.489364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4909a524-6364-4c5f-ad7d-1ed41f199c5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:23.490378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4909a524-6364-4c5f-ad7d-1ed41f199c5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:23.491059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4909a524-6364-4c5f-ad7d-1ed41f199c5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:23.550302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4909a524-6364-4c5f-ad7d-1ed41f199c5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:23.558289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4909a524-6364-4c5f-ad7d-1ed41f199c5b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083997 Feb 21 01:01:23.558862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 644/1103] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:23 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:24.579593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-630d4bda-1d39-4864-b914-cd73f89e8964 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:24.580617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-630d4bda-1d39-4864-b914-cd73f89e8964 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:24.591240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-630d4bda-1d39-4864-b914-cd73f89e8964 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:24.591980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-630d4bda-1d39-4864-b914-cd73f89e8964 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:24.593355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-630d4bda-1d39-4864-b914-cd73f89e8964 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:24.594023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-630d4bda-1d39-4864-b914-cd73f89e8964 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:24.657595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-630d4bda-1d39-4864-b914-cd73f89e8964 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:24.665135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-630d4bda-1d39-4864-b914-cd73f89e8964 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092055 Feb 21 01:01:24.665707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 460/1104] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:24 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:25.686469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fcec6dab-72cf-4b3b-a9c5-06140ad41cd6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:25.687454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fcec6dab-72cf-4b3b-a9c5-06140ad41cd6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:25.698487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fcec6dab-72cf-4b3b-a9c5-06140ad41cd6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:25.699252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fcec6dab-72cf-4b3b-a9c5-06140ad41cd6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:25.700601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fcec6dab-72cf-4b3b-a9c5-06140ad41cd6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:25.701341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fcec6dab-72cf-4b3b-a9c5-06140ad41cd6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:25.775019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fcec6dab-72cf-4b3b-a9c5-06140ad41cd6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:25.783775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fcec6dab-72cf-4b3b-a9c5-06140ad41cd6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.103745 Feb 21 01:01:25.784311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 645/1105] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:25 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:26.810004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6e45d4ca-9440-459f-a176-08a7bcaccb7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:26.810968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6e45d4ca-9440-459f-a176-08a7bcaccb7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:26.821812 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6e45d4ca-9440-459f-a176-08a7bcaccb7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:26.822265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6e45d4ca-9440-459f-a176-08a7bcaccb7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:26.823068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6e45d4ca-9440-459f-a176-08a7bcaccb7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:26.823490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6e45d4ca-9440-459f-a176-08a7bcaccb7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:26.897665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6e45d4ca-9440-459f-a176-08a7bcaccb7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:26.906085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6e45d4ca-9440-459f-a176-08a7bcaccb7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.102255 Feb 21 01:01:26.906605 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 461/1106] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:27.928243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bf9f486e-1301-4007-9117-098a37f039b7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:27.929274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bf9f486e-1301-4007-9117-098a37f039b7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:27.937665 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf9f486e-1301-4007-9117-098a37f039b7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:27.938113 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf9f486e-1301-4007-9117-098a37f039b7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:27.938890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf9f486e-1301-4007-9117-098a37f039b7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:27.939312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf9f486e-1301-4007-9117-098a37f039b7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:28.013602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bf9f486e-1301-4007-9117-098a37f039b7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:28.022240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bf9f486e-1301-4007-9117-098a37f039b7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100713 Feb 21 01:01:28.022825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 646/1107] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:29.043977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cea92d38-d847-4ffd-bc20-09f9376f2895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:29.044607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cea92d38-d847-4ffd-bc20-09f9376f2895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:29.050975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cea92d38-d847-4ffd-bc20-09f9376f2895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:29.051424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cea92d38-d847-4ffd-bc20-09f9376f2895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:29.052414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cea92d38-d847-4ffd-bc20-09f9376f2895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:29.052887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cea92d38-d847-4ffd-bc20-09f9376f2895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:29.117734 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cea92d38-d847-4ffd-bc20-09f9376f2895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:29.125683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cea92d38-d847-4ffd-bc20-09f9376f2895 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087313 Feb 21 01:01:29.126252 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 462/1108] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:29 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:30.142807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f26d8983-b501-47db-9e64-b5d0bf3cfb92 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:30.143415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f26d8983-b501-47db-9e64-b5d0bf3cfb92 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:30.150218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f26d8983-b501-47db-9e64-b5d0bf3cfb92 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:30.150669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f26d8983-b501-47db-9e64-b5d0bf3cfb92 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:30.151446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f26d8983-b501-47db-9e64-b5d0bf3cfb92 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:30.151971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f26d8983-b501-47db-9e64-b5d0bf3cfb92 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:30.214539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f26d8983-b501-47db-9e64-b5d0bf3cfb92 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:30.222246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f26d8983-b501-47db-9e64-b5d0bf3cfb92 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083179 Feb 21 01:01:30.222820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 647/1109] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:30 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:31.242449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-351aebe3-9123-4a3c-9f99-fa9ad5a1c4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:31.243428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-351aebe3-9123-4a3c-9f99-fa9ad5a1c4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:31.254344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-351aebe3-9123-4a3c-9f99-fa9ad5a1c4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:31.254985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-351aebe3-9123-4a3c-9f99-fa9ad5a1c4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:31.256601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-351aebe3-9123-4a3c-9f99-fa9ad5a1c4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:31.257002 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-351aebe3-9123-4a3c-9f99-fa9ad5a1c4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:31.321189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-351aebe3-9123-4a3c-9f99-fa9ad5a1c4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:31.329351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-351aebe3-9123-4a3c-9f99-fa9ad5a1c4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093073 Feb 21 01:01:31.329912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 463/1110] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:31 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:32.350017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f613b747-0ff4-4f55-b03c-96ff6067a650 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:32.351009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f613b747-0ff4-4f55-b03c-96ff6067a650 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:32.361622 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f613b747-0ff4-4f55-b03c-96ff6067a650 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:32.362357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f613b747-0ff4-4f55-b03c-96ff6067a650 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:32.363631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f613b747-0ff4-4f55-b03c-96ff6067a650 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:32.364345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f613b747-0ff4-4f55-b03c-96ff6067a650 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:32.431315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f613b747-0ff4-4f55-b03c-96ff6067a650 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:32.440570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f613b747-0ff4-4f55-b03c-96ff6067a650 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096626 Feb 21 01:01:32.441164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 648/1111] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:32 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:33.460358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c133b748-cd2e-467c-b5e7-f3994a3cac2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:33.461181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c133b748-cd2e-467c-b5e7-f3994a3cac2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:33.470448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c133b748-cd2e-467c-b5e7-f3994a3cac2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:33.471117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c133b748-cd2e-467c-b5e7-f3994a3cac2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:33.472292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c133b748-cd2e-467c-b5e7-f3994a3cac2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:33.472935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c133b748-cd2e-467c-b5e7-f3994a3cac2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:33.536303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c133b748-cd2e-467c-b5e7-f3994a3cac2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:33.544237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c133b748-cd2e-467c-b5e7-f3994a3cac2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089141 Feb 21 01:01:33.544827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 464/1112] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:33 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:34.562554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-537fd698-c4c9-4a43-9967-8ec51a7900a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:34.563171 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-537fd698-c4c9-4a43-9967-8ec51a7900a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:34.569917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-537fd698-c4c9-4a43-9967-8ec51a7900a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:34.570368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-537fd698-c4c9-4a43-9967-8ec51a7900a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:34.571146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-537fd698-c4c9-4a43-9967-8ec51a7900a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:34.571579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-537fd698-c4c9-4a43-9967-8ec51a7900a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:34.637080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-537fd698-c4c9-4a43-9967-8ec51a7900a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:34.644659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-537fd698-c4c9-4a43-9967-8ec51a7900a2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085796 Feb 21 01:01:34.645240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 649/1113] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:34 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:35.302646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:01:35.303134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:01:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:01:35.666568 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b4f499e7-355a-40d7-82ae-86463b5c439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:35.667700 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b4f499e7-355a-40d7-82ae-86463b5c439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:35.674672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4f499e7-355a-40d7-82ae-86463b5c439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:35.675113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4f499e7-355a-40d7-82ae-86463b5c439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:35.675900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4f499e7-355a-40d7-82ae-86463b5c439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:35.676318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4f499e7-355a-40d7-82ae-86463b5c439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:35.745514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b4f499e7-355a-40d7-82ae-86463b5c439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:35.753017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b4f499e7-355a-40d7-82ae-86463b5c439e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092924 Feb 21 01:01:35.753570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 465/1114] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:35 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:36.777037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c9839ed5-5140-4438-bace-5e0152fa0be2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:36.778401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c9839ed5-5140-4438-bace-5e0152fa0be2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:36.789199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c9839ed5-5140-4438-bace-5e0152fa0be2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:36.789789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c9839ed5-5140-4438-bace-5e0152fa0be2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:36.791068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c9839ed5-5140-4438-bace-5e0152fa0be2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:36.791779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c9839ed5-5140-4438-bace-5e0152fa0be2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:36.857659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c9839ed5-5140-4438-bace-5e0152fa0be2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:36.865129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c9839ed5-5140-4438-bace-5e0152fa0be2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094530 Feb 21 01:01:36.865701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 650/1115] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:36 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:37.886960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1cd82176-2e68-454b-9dfd-a02eb8782cc0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:37.887653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1cd82176-2e68-454b-9dfd-a02eb8782cc0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:37.895875 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cd82176-2e68-454b-9dfd-a02eb8782cc0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:37.896414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cd82176-2e68-454b-9dfd-a02eb8782cc0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:37.897423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cd82176-2e68-454b-9dfd-a02eb8782cc0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:37.897961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cd82176-2e68-454b-9dfd-a02eb8782cc0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:37.963933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1cd82176-2e68-454b-9dfd-a02eb8782cc0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:37.971756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1cd82176-2e68-454b-9dfd-a02eb8782cc0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091160 Feb 21 01:01:37.972324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 466/1116] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:38.992575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2f1114df-e1cd-49a3-bcd4-ce0a2a875a82 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:38.993631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2f1114df-e1cd-49a3-bcd4-ce0a2a875a82 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:39.001087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f1114df-e1cd-49a3-bcd4-ce0a2a875a82 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:39.001526 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f1114df-e1cd-49a3-bcd4-ce0a2a875a82 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:39.002301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f1114df-e1cd-49a3-bcd4-ce0a2a875a82 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:39.002721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f1114df-e1cd-49a3-bcd4-ce0a2a875a82 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:39.062217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2f1114df-e1cd-49a3-bcd4-ce0a2a875a82 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:39.070084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2f1114df-e1cd-49a3-bcd4-ce0a2a875a82 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083849 Feb 21 01:01:39.070654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 651/1117] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:38 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:40.090631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d2482f3e-5c8d-471b-b73c-37204f35bd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:40.091351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d2482f3e-5c8d-471b-b73c-37204f35bd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:40.099200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d2482f3e-5c8d-471b-b73c-37204f35bd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:40.099715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d2482f3e-5c8d-471b-b73c-37204f35bd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:40.100671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d2482f3e-5c8d-471b-b73c-37204f35bd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:40.101169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d2482f3e-5c8d-471b-b73c-37204f35bd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:40.166035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d2482f3e-5c8d-471b-b73c-37204f35bd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:40.174017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d2482f3e-5c8d-471b-b73c-37204f35bd1a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089314 Feb 21 01:01:40.174572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 467/1118] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:40 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:41.194046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f541d985-cf72-41b8-a5b9-3aa74a5d37ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:41.194885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f541d985-cf72-41b8-a5b9-3aa74a5d37ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:41.205422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f541d985-cf72-41b8-a5b9-3aa74a5d37ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:41.205867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f541d985-cf72-41b8-a5b9-3aa74a5d37ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:41.206638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f541d985-cf72-41b8-a5b9-3aa74a5d37ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:41.207063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f541d985-cf72-41b8-a5b9-3aa74a5d37ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:41.273693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f541d985-cf72-41b8-a5b9-3aa74a5d37ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:41.282034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f541d985-cf72-41b8-a5b9-3aa74a5d37ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094196 Feb 21 01:01:41.282599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 652/1119] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:42.300838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a0fe5f7f-5da7-4fa2-b82c-282591fe3f3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:42.301577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a0fe5f7f-5da7-4fa2-b82c-282591fe3f3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:42.309510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0fe5f7f-5da7-4fa2-b82c-282591fe3f3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:42.309956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0fe5f7f-5da7-4fa2-b82c-282591fe3f3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:42.310727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0fe5f7f-5da7-4fa2-b82c-282591fe3f3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:42.311153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0fe5f7f-5da7-4fa2-b82c-282591fe3f3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:42.375463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a0fe5f7f-5da7-4fa2-b82c-282591fe3f3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:42.383097 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a0fe5f7f-5da7-4fa2-b82c-282591fe3f3f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087057 Feb 21 01:01:42.383644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 468/1120] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:42 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:43.406461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fea5fef2-3970-4b4b-ba76-6c24972aed2c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:43.407348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fea5fef2-3970-4b4b-ba76-6c24972aed2c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:43.417340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fea5fef2-3970-4b4b-ba76-6c24972aed2c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:43.418015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fea5fef2-3970-4b4b-ba76-6c24972aed2c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:43.418795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fea5fef2-3970-4b4b-ba76-6c24972aed2c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:43.419187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fea5fef2-3970-4b4b-ba76-6c24972aed2c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:43.479891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fea5fef2-3970-4b4b-ba76-6c24972aed2c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:43.487487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fea5fef2-3970-4b4b-ba76-6c24972aed2c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087190 Feb 21 01:01:43.488092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 653/1121] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:43 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:44.508449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a7f79275-c8d9-4e6c-9690-b969f4d0bb28 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:44.509388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a7f79275-c8d9-4e6c-9690-b969f4d0bb28 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:44.520448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7f79275-c8d9-4e6c-9690-b969f4d0bb28 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:44.521197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7f79275-c8d9-4e6c-9690-b969f4d0bb28 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:44.522445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7f79275-c8d9-4e6c-9690-b969f4d0bb28 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:44.523174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7f79275-c8d9-4e6c-9690-b969f4d0bb28 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:44.593315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a7f79275-c8d9-4e6c-9690-b969f4d0bb28 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:44.603780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a7f79275-c8d9-4e6c-9690-b969f4d0bb28 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.101115 Feb 21 01:01:44.604618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 469/1122] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:44 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:45.624629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b63fa2a2-21cf-4f16-9740-de333d1fae88 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:45.625661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b63fa2a2-21cf-4f16-9740-de333d1fae88 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:45.636178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b63fa2a2-21cf-4f16-9740-de333d1fae88 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:45.636648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b63fa2a2-21cf-4f16-9740-de333d1fae88 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:45.637450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b63fa2a2-21cf-4f16-9740-de333d1fae88 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:45.637876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b63fa2a2-21cf-4f16-9740-de333d1fae88 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:45.716587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b63fa2a2-21cf-4f16-9740-de333d1fae88 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:45.727955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b63fa2a2-21cf-4f16-9740-de333d1fae88 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.109247 Feb 21 01:01:45.728719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 654/1123] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:45 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:46.747569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5af15ba6-8d70-4889-83b2-41fea47ef362 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:46.748153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5af15ba6-8d70-4889-83b2-41fea47ef362 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:46.754852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5af15ba6-8d70-4889-83b2-41fea47ef362 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:46.755292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5af15ba6-8d70-4889-83b2-41fea47ef362 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:46.756069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5af15ba6-8d70-4889-83b2-41fea47ef362 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:46.756529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5af15ba6-8d70-4889-83b2-41fea47ef362 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:46.816121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5af15ba6-8d70-4889-83b2-41fea47ef362 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:46.823949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5af15ba6-8d70-4889-83b2-41fea47ef362 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.081264 Feb 21 01:01:46.824534 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 470/1124] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:46 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:47.844811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a7bd9683-6cfc-4c7b-acff-aa2dd0070500 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:47.845699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a7bd9683-6cfc-4c7b-acff-aa2dd0070500 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:47.855918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7bd9683-6cfc-4c7b-acff-aa2dd0070500 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:47.856352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7bd9683-6cfc-4c7b-acff-aa2dd0070500 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:47.857150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7bd9683-6cfc-4c7b-acff-aa2dd0070500 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:47.857570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7bd9683-6cfc-4c7b-acff-aa2dd0070500 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:47.926942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a7bd9683-6cfc-4c7b-acff-aa2dd0070500 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:47.934715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a7bd9683-6cfc-4c7b-acff-aa2dd0070500 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096269 Feb 21 01:01:47.935283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 655/1125] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:48.954609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-862d310c-d0da-436a-b948-fc5fac7416f4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:48.955536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-862d310c-d0da-436a-b948-fc5fac7416f4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:48.966073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-862d310c-d0da-436a-b948-fc5fac7416f4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:48.966512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-862d310c-d0da-436a-b948-fc5fac7416f4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:48.967281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-862d310c-d0da-436a-b948-fc5fac7416f4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:48.967709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-862d310c-d0da-436a-b948-fc5fac7416f4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:49.026886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-862d310c-d0da-436a-b948-fc5fac7416f4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:49.035154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-862d310c-d0da-436a-b948-fc5fac7416f4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086917 Feb 21 01:01:49.035706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 471/1126] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:48 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:50.056149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b18a2bd6-5dc9-4ce1-80e9-5e22e3c69ba8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:50.057176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b18a2bd6-5dc9-4ce1-80e9-5e22e3c69ba8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:50.068053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b18a2bd6-5dc9-4ce1-80e9-5e22e3c69ba8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:50.068858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b18a2bd6-5dc9-4ce1-80e9-5e22e3c69ba8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:50.070127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b18a2bd6-5dc9-4ce1-80e9-5e22e3c69ba8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:50.070846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b18a2bd6-5dc9-4ce1-80e9-5e22e3c69ba8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:50.134321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b18a2bd6-5dc9-4ce1-80e9-5e22e3c69ba8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:50.142028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b18a2bd6-5dc9-4ce1-80e9-5e22e3c69ba8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092090 Feb 21 01:01:50.142588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 656/1127] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:50 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:51.164976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f0f1e91f-85b4-4623-be54-49362f4f2088 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:51.165992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f0f1e91f-85b4-4623-be54-49362f4f2088 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:51.176951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0f1e91f-85b4-4623-be54-49362f4f2088 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:51.177690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0f1e91f-85b4-4623-be54-49362f4f2088 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:51.178965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0f1e91f-85b4-4623-be54-49362f4f2088 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:51.179671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0f1e91f-85b4-4623-be54-49362f4f2088 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:51.250706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f0f1e91f-85b4-4623-be54-49362f4f2088 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:51.262129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f0f1e91f-85b4-4623-be54-49362f4f2088 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.103141 Feb 21 01:01:51.262696 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 472/1128] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:51.534335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:01:51.535081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:01:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:01:52.282370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7f4fb357-f644-40b8-b4e8-39ad34da6fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:52.283014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7f4fb357-f644-40b8-b4e8-39ad34da6fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:52.290222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f4fb357-f644-40b8-b4e8-39ad34da6fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:52.290714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f4fb357-f644-40b8-b4e8-39ad34da6fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:52.291538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f4fb357-f644-40b8-b4e8-39ad34da6fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:52.292012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f4fb357-f644-40b8-b4e8-39ad34da6fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:52.355746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7f4fb357-f644-40b8-b4e8-39ad34da6fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:52.364001 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7f4fb357-f644-40b8-b4e8-39ad34da6fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086118 Feb 21 01:01:52.364611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 657/1129] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:52.593716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:01:52.594588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:01:53.381443 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bd61ba8f-d925-4fe6-b4f1-c936a8533775 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:53.382126 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bd61ba8f-d925-4fe6-b4f1-c936a8533775 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:53.388844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd61ba8f-d925-4fe6-b4f1-c936a8533775 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:53.389292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd61ba8f-d925-4fe6-b4f1-c936a8533775 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:53.390069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd61ba8f-d925-4fe6-b4f1-c936a8533775 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:53.390489 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd61ba8f-d925-4fe6-b4f1-c936a8533775 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:53.454367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bd61ba8f-d925-4fe6-b4f1-c936a8533775 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:53.461785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bd61ba8f-d925-4fe6-b4f1-c936a8533775 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084167 Feb 21 01:01:53.462338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 473/1130] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:53 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:54.479168 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e40d2fca-756c-4ba6-b672-319895769d9d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:54.479762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e40d2fca-756c-4ba6-b672-319895769d9d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:54.486882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e40d2fca-756c-4ba6-b672-319895769d9d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:54.487329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e40d2fca-756c-4ba6-b672-319895769d9d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:54.488107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e40d2fca-756c-4ba6-b672-319895769d9d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:54.488565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e40d2fca-756c-4ba6-b672-319895769d9d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:54.560240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e40d2fca-756c-4ba6-b672-319895769d9d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:54.568098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e40d2fca-756c-4ba6-b672-319895769d9d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092824 Feb 21 01:01:54.568748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 658/1131] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:54 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:55.035210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:01:55.036054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:01:55.589005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ff83db6d-a035-4280-983e-0eace19d2078 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:55.590015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ff83db6d-a035-4280-983e-0eace19d2078 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:55.599519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff83db6d-a035-4280-983e-0eace19d2078 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:55.599966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff83db6d-a035-4280-983e-0eace19d2078 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:55.600851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff83db6d-a035-4280-983e-0eace19d2078 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:55.601281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff83db6d-a035-4280-983e-0eace19d2078 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:55.670395 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ff83db6d-a035-4280-983e-0eace19d2078 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:55.678294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ff83db6d-a035-4280-983e-0eace19d2078 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095456 Feb 21 01:01:55.678827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 474/1132] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:56.703053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5f858c1d-6dda-41be-995d-c1d9eeb56cee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:56.703685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5f858c1d-6dda-41be-995d-c1d9eeb56cee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:56.713143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f858c1d-6dda-41be-995d-c1d9eeb56cee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:56.713583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f858c1d-6dda-41be-995d-c1d9eeb56cee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:56.714697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f858c1d-6dda-41be-995d-c1d9eeb56cee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:56.715271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f858c1d-6dda-41be-995d-c1d9eeb56cee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:56.785306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5f858c1d-6dda-41be-995d-c1d9eeb56cee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:56.794728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5f858c1d-6dda-41be-995d-c1d9eeb56cee tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097538 Feb 21 01:01:56.795295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 659/1133] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:57.820683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e9bc5bc2-7221-4d60-9e88-6f5bd43c4079 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:57.821514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e9bc5bc2-7221-4d60-9e88-6f5bd43c4079 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:57.832775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e9bc5bc2-7221-4d60-9e88-6f5bd43c4079 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:57.833512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e9bc5bc2-7221-4d60-9e88-6f5bd43c4079 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:57.834915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e9bc5bc2-7221-4d60-9e88-6f5bd43c4079 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:57.835629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e9bc5bc2-7221-4d60-9e88-6f5bd43c4079 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:57.901400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e9bc5bc2-7221-4d60-9e88-6f5bd43c4079 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:57.909814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e9bc5bc2-7221-4d60-9e88-6f5bd43c4079 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095638 Feb 21 01:01:57.910383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 475/1134] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:01:58.930741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4790fbea-cc36-43f1-8b2e-543e213a0684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:01:58.931796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4790fbea-cc36-43f1-8b2e-543e213a0684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:01:58.942306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4790fbea-cc36-43f1-8b2e-543e213a0684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:58.943039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4790fbea-cc36-43f1-8b2e-543e213a0684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:58.944314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4790fbea-cc36-43f1-8b2e-543e213a0684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:01:58.945057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4790fbea-cc36-43f1-8b2e-543e213a0684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:01:59.012502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4790fbea-cc36-43f1-8b2e-543e213a0684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:01:59.024162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4790fbea-cc36-43f1-8b2e-543e213a0684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.099776 Feb 21 01:01:59.024951 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 660/1135] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:01:58 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:00.049536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1c642667-d8aa-43e2-b75b-636579e99416 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:00.050511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1c642667-d8aa-43e2-b75b-636579e99416 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:00.060674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c642667-d8aa-43e2-b75b-636579e99416 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:00.061417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c642667-d8aa-43e2-b75b-636579e99416 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:00.062680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c642667-d8aa-43e2-b75b-636579e99416 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:00.063383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c642667-d8aa-43e2-b75b-636579e99416 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:00.124023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1c642667-d8aa-43e2-b75b-636579e99416 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:00.131845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1c642667-d8aa-43e2-b75b-636579e99416 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088506 Feb 21 01:02:00.132420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 476/1136] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:01.153029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-386c37cf-8ca7-4448-bd86-55004ea4e802 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:01.154008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-386c37cf-8ca7-4448-bd86-55004ea4e802 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:01.164748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-386c37cf-8ca7-4448-bd86-55004ea4e802 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:01.165480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-386c37cf-8ca7-4448-bd86-55004ea4e802 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:01.166748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-386c37cf-8ca7-4448-bd86-55004ea4e802 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:01.167441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-386c37cf-8ca7-4448-bd86-55004ea4e802 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:01.232539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-386c37cf-8ca7-4448-bd86-55004ea4e802 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:01.240143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-386c37cf-8ca7-4448-bd86-55004ea4e802 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093919 Feb 21 01:02:01.240751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 661/1137] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:01 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:02.261661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-aa063164-4026-4174-85c9-8446f19b019a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:02.262715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-aa063164-4026-4174-85c9-8446f19b019a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:02.273433 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aa063164-4026-4174-85c9-8446f19b019a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:02.274165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aa063164-4026-4174-85c9-8446f19b019a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:02.275453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aa063164-4026-4174-85c9-8446f19b019a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:02.276228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aa063164-4026-4174-85c9-8446f19b019a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:02.345248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-aa063164-4026-4174-85c9-8446f19b019a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:02.353005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-aa063164-4026-4174-85c9-8446f19b019a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097901 Feb 21 01:02:02.353569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 477/1138] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:03.371710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e5d1174e-dbe3-43f0-b445-6beee72b4cf4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:03.372347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e5d1174e-dbe3-43f0-b445-6beee72b4cf4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:03.382212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e5d1174e-dbe3-43f0-b445-6beee72b4cf4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:03.382655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e5d1174e-dbe3-43f0-b445-6beee72b4cf4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:03.383461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e5d1174e-dbe3-43f0-b445-6beee72b4cf4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:03.383885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e5d1174e-dbe3-43f0-b445-6beee72b4cf4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:03.454971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e5d1174e-dbe3-43f0-b445-6beee72b4cf4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:03.463293 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e5d1174e-dbe3-43f0-b445-6beee72b4cf4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095445 Feb 21 01:02:03.464019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 662/1139] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:03 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:04.484450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5027aa76-e69b-45d1-a7e2-c517554612bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:04.485521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5027aa76-e69b-45d1-a7e2-c517554612bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:04.496662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5027aa76-e69b-45d1-a7e2-c517554612bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:04.497427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5027aa76-e69b-45d1-a7e2-c517554612bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:04.498723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5027aa76-e69b-45d1-a7e2-c517554612bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:04.499451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5027aa76-e69b-45d1-a7e2-c517554612bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:04.566230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5027aa76-e69b-45d1-a7e2-c517554612bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:04.573884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5027aa76-e69b-45d1-a7e2-c517554612bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095820 Feb 21 01:02:04.574518 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 478/1140] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:04 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:05.592984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a4cf0387-73f5-4a19-bb4b-a972bf2fff41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:05.593699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a4cf0387-73f5-4a19-bb4b-a972bf2fff41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:05.601563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a4cf0387-73f5-4a19-bb4b-a972bf2fff41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:05.602110 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a4cf0387-73f5-4a19-bb4b-a972bf2fff41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:05.603036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a4cf0387-73f5-4a19-bb4b-a972bf2fff41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:05.603546 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a4cf0387-73f5-4a19-bb4b-a972bf2fff41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:05.665968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a4cf0387-73f5-4a19-bb4b-a972bf2fff41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:05.673484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a4cf0387-73f5-4a19-bb4b-a972bf2fff41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084942 Feb 21 01:02:05.674044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 663/1141] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:05 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:06.690690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f645a5e2-4fbf-4f03-b888-7c23f3d915ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:06.691282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f645a5e2-4fbf-4f03-b888-7c23f3d915ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:06.698105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f645a5e2-4fbf-4f03-b888-7c23f3d915ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:06.698548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f645a5e2-4fbf-4f03-b888-7c23f3d915ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:06.699328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f645a5e2-4fbf-4f03-b888-7c23f3d915ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:06.699765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f645a5e2-4fbf-4f03-b888-7c23f3d915ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:06.770095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f645a5e2-4fbf-4f03-b888-7c23f3d915ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:06.778555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f645a5e2-4fbf-4f03-b888-7c23f3d915ae tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091610 Feb 21 01:02:06.779108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 479/1142] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:06 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:07.799358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-de5c6943-1718-412a-a6da-cef2f492e2fc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:07.800312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-de5c6943-1718-412a-a6da-cef2f492e2fc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:07.809266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de5c6943-1718-412a-a6da-cef2f492e2fc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:07.809719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de5c6943-1718-412a-a6da-cef2f492e2fc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:07.810497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de5c6943-1718-412a-a6da-cef2f492e2fc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:07.810925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-de5c6943-1718-412a-a6da-cef2f492e2fc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:07.886421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-de5c6943-1718-412a-a6da-cef2f492e2fc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:07.894238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-de5c6943-1718-412a-a6da-cef2f492e2fc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.101048 Feb 21 01:02:07.894810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 664/1143] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:07 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:08.915374 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3f174db8-2f48-42fd-9c4a-b12c022f6e23 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:08.916261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3f174db8-2f48-42fd-9c4a-b12c022f6e23 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:08.927011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f174db8-2f48-42fd-9c4a-b12c022f6e23 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:08.927751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f174db8-2f48-42fd-9c4a-b12c022f6e23 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:08.929087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f174db8-2f48-42fd-9c4a-b12c022f6e23 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:08.929795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3f174db8-2f48-42fd-9c4a-b12c022f6e23 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:08.998265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3f174db8-2f48-42fd-9c4a-b12c022f6e23 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:09.009673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3f174db8-2f48-42fd-9c4a-b12c022f6e23 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100943 Feb 21 01:02:09.010268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 480/1144] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:08 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:10.030923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-80a5b70f-23a0-4c58-a190-ddb48561b3e8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:10.031985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-80a5b70f-23a0-4c58-a190-ddb48561b3e8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:10.042629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80a5b70f-23a0-4c58-a190-ddb48561b3e8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:10.043417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80a5b70f-23a0-4c58-a190-ddb48561b3e8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:10.044809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80a5b70f-23a0-4c58-a190-ddb48561b3e8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:10.045543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80a5b70f-23a0-4c58-a190-ddb48561b3e8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:10.114166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-80a5b70f-23a0-4c58-a190-ddb48561b3e8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:10.125201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-80a5b70f-23a0-4c58-a190-ddb48561b3e8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100703 Feb 21 01:02:10.125875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 665/1145] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:10 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:11.149207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5924d80f-c186-4717-889e-fdd302e56ac2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:11.150157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5924d80f-c186-4717-889e-fdd302e56ac2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:11.161231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5924d80f-c186-4717-889e-fdd302e56ac2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:11.161971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5924d80f-c186-4717-889e-fdd302e56ac2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:11.163245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5924d80f-c186-4717-889e-fdd302e56ac2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:11.163957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5924d80f-c186-4717-889e-fdd302e56ac2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:11.222826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5924d80f-c186-4717-889e-fdd302e56ac2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:11.230314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5924d80f-c186-4717-889e-fdd302e56ac2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087263 Feb 21 01:02:11.230869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 481/1146] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:11 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:12.251668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-56d036df-c25c-447e-8039-13e58c27b7aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:12.252797 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-56d036df-c25c-447e-8039-13e58c27b7aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:12.263544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56d036df-c25c-447e-8039-13e58c27b7aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:12.264300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56d036df-c25c-447e-8039-13e58c27b7aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:12.265620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56d036df-c25c-447e-8039-13e58c27b7aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:12.266327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56d036df-c25c-447e-8039-13e58c27b7aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:12.330398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-56d036df-c25c-447e-8039-13e58c27b7aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:12.337899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-56d036df-c25c-447e-8039-13e58c27b7aa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092716 Feb 21 01:02:12.338486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 666/1147] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:12 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:13.362889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-53a88eed-2127-4809-a136-9b9f3a8ca042 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:13.363800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-53a88eed-2127-4809-a136-9b9f3a8ca042 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:13.374491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53a88eed-2127-4809-a136-9b9f3a8ca042 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:13.375213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53a88eed-2127-4809-a136-9b9f3a8ca042 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:13.376447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53a88eed-2127-4809-a136-9b9f3a8ca042 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:13.377177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53a88eed-2127-4809-a136-9b9f3a8ca042 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:13.440860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53a88eed-2127-4809-a136-9b9f3a8ca042 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:13.448662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-53a88eed-2127-4809-a136-9b9f3a8ca042 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091407 Feb 21 01:02:13.449567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 482/1148] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:14.466035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-43db9def-b849-48eb-8bbe-a7857d90f9fa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:14.466652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-43db9def-b849-48eb-8bbe-a7857d90f9fa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:14.473589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43db9def-b849-48eb-8bbe-a7857d90f9fa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:14.474032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43db9def-b849-48eb-8bbe-a7857d90f9fa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:14.474798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43db9def-b849-48eb-8bbe-a7857d90f9fa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:14.475226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43db9def-b849-48eb-8bbe-a7857d90f9fa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:14.545193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-43db9def-b849-48eb-8bbe-a7857d90f9fa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:14.553030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-43db9def-b849-48eb-8bbe-a7857d90f9fa tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091137 Feb 21 01:02:14.553600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 667/1149] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:15.574254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-19ff13b1-5df7-427d-bdfb-3a9bbf86b1d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:15.574819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-19ff13b1-5df7-427d-bdfb-3a9bbf86b1d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:15.582107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19ff13b1-5df7-427d-bdfb-3a9bbf86b1d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:15.582558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19ff13b1-5df7-427d-bdfb-3a9bbf86b1d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:15.583337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19ff13b1-5df7-427d-bdfb-3a9bbf86b1d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:15.583814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19ff13b1-5df7-427d-bdfb-3a9bbf86b1d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:15.657631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19ff13b1-5df7-427d-bdfb-3a9bbf86b1d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:15.669865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-19ff13b1-5df7-427d-bdfb-3a9bbf86b1d5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.101749 Feb 21 01:02:15.670619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 483/1150] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:16.695392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dcccc395-c3b6-451d-8433-fbbe5d684815 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:16.696460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dcccc395-c3b6-451d-8433-fbbe5d684815 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:16.707021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcccc395-c3b6-451d-8433-fbbe5d684815 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:16.707755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcccc395-c3b6-451d-8433-fbbe5d684815 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:16.709071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcccc395-c3b6-451d-8433-fbbe5d684815 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:16.709810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcccc395-c3b6-451d-8433-fbbe5d684815 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:16.790708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dcccc395-c3b6-451d-8433-fbbe5d684815 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:16.798557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dcccc395-c3b6-451d-8433-fbbe5d684815 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.109411 Feb 21 01:02:16.799143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 668/1151] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:17.819088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fe362048-ed60-41f5-92f2-b6a0ba338047 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:17.820108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fe362048-ed60-41f5-92f2-b6a0ba338047 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:17.828144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe362048-ed60-41f5-92f2-b6a0ba338047 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:17.828623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe362048-ed60-41f5-92f2-b6a0ba338047 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:17.829376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe362048-ed60-41f5-92f2-b6a0ba338047 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:17.829828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe362048-ed60-41f5-92f2-b6a0ba338047 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:17.889791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fe362048-ed60-41f5-92f2-b6a0ba338047 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:17.898021 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fe362048-ed60-41f5-92f2-b6a0ba338047 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085048 Feb 21 01:02:17.898582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 484/1152] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:17 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:18.919352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-86c54831-40ea-4e0f-9db7-02c7feaeba48 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:18.920232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-86c54831-40ea-4e0f-9db7-02c7feaeba48 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:18.930836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86c54831-40ea-4e0f-9db7-02c7feaeba48 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:18.931625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86c54831-40ea-4e0f-9db7-02c7feaeba48 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:18.932963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86c54831-40ea-4e0f-9db7-02c7feaeba48 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:18.933713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86c54831-40ea-4e0f-9db7-02c7feaeba48 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:18.993208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-86c54831-40ea-4e0f-9db7-02c7feaeba48 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:19.001045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-86c54831-40ea-4e0f-9db7-02c7feaeba48 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088073 Feb 21 01:02:19.001613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 669/1153] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:18 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:20.022360 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a50369a6-77b1-492f-844f-3e40c0bf3bb5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:20.023381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a50369a6-77b1-492f-844f-3e40c0bf3bb5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:20.034364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a50369a6-77b1-492f-844f-3e40c0bf3bb5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:20.035105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a50369a6-77b1-492f-844f-3e40c0bf3bb5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:20.036425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a50369a6-77b1-492f-844f-3e40c0bf3bb5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:20.037148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a50369a6-77b1-492f-844f-3e40c0bf3bb5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:20.099291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a50369a6-77b1-492f-844f-3e40c0bf3bb5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:20.107182 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a50369a6-77b1-492f-844f-3e40c0bf3bb5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091369 Feb 21 01:02:20.107739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 485/1154] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:20 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:21.126993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d907cace-c3aa-4cfe-954a-306752eb1670 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:21.127943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d907cace-c3aa-4cfe-954a-306752eb1670 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:21.138400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d907cace-c3aa-4cfe-954a-306752eb1670 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:21.139117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d907cace-c3aa-4cfe-954a-306752eb1670 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:21.140372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d907cace-c3aa-4cfe-954a-306752eb1670 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:21.141118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d907cace-c3aa-4cfe-954a-306752eb1670 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:21.207632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d907cace-c3aa-4cfe-954a-306752eb1670 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:21.216978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d907cace-c3aa-4cfe-954a-306752eb1670 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096262 Feb 21 01:02:21.217558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 670/1155] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:21 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:22.238029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9ea1efed-355c-44b7-a12f-3c1a3e0d4045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:22.239045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9ea1efed-355c-44b7-a12f-3c1a3e0d4045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:22.249578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ea1efed-355c-44b7-a12f-3c1a3e0d4045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:22.250312 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ea1efed-355c-44b7-a12f-3c1a3e0d4045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:22.251582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ea1efed-355c-44b7-a12f-3c1a3e0d4045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:22.252287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ea1efed-355c-44b7-a12f-3c1a3e0d4045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:22.316837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ea1efed-355c-44b7-a12f-3c1a3e0d4045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:22.324695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9ea1efed-355c-44b7-a12f-3c1a3e0d4045 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092773 Feb 21 01:02:22.325268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 486/1156] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:22 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:23.343504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5b97c82f-e9c1-41f9-b8f5-c19d4489b105 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:23.344255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5b97c82f-e9c1-41f9-b8f5-c19d4489b105 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:23.352353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b97c82f-e9c1-41f9-b8f5-c19d4489b105 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:23.352939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b97c82f-e9c1-41f9-b8f5-c19d4489b105 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:23.353900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b97c82f-e9c1-41f9-b8f5-c19d4489b105 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:23.354433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5b97c82f-e9c1-41f9-b8f5-c19d4489b105 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:23.420863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5b97c82f-e9c1-41f9-b8f5-c19d4489b105 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:23.428791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5b97c82f-e9c1-41f9-b8f5-c19d4489b105 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090095 Feb 21 01:02:23.429364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 671/1157] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:23 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:24.450316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1a8c3ec2-f5b5-4cff-a05d-24f8b79d4d3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:24.450979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1a8c3ec2-f5b5-4cff-a05d-24f8b79d4d3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:24.458039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a8c3ec2-f5b5-4cff-a05d-24f8b79d4d3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:24.458536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a8c3ec2-f5b5-4cff-a05d-24f8b79d4d3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:24.459374 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a8c3ec2-f5b5-4cff-a05d-24f8b79d4d3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:24.459815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a8c3ec2-f5b5-4cff-a05d-24f8b79d4d3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:24.522322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a8c3ec2-f5b5-4cff-a05d-24f8b79d4d3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:24.530959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1a8c3ec2-f5b5-4cff-a05d-24f8b79d4d3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086553 Feb 21 01:02:24.531555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 487/1158] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:24 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:25.550392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-85cd902f-72fa-4666-ae25-809ea6de5502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:25.551009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-85cd902f-72fa-4666-ae25-809ea6de5502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:25.561265 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-85cd902f-72fa-4666-ae25-809ea6de5502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:25.561705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-85cd902f-72fa-4666-ae25-809ea6de5502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:25.562467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-85cd902f-72fa-4666-ae25-809ea6de5502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:25.562886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-85cd902f-72fa-4666-ae25-809ea6de5502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:25.624701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-85cd902f-72fa-4666-ae25-809ea6de5502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:25.632889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-85cd902f-72fa-4666-ae25-809ea6de5502 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088586 Feb 21 01:02:25.633480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 672/1159] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:25 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:26.653724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a1883866-a3f7-4a72-a040-15c9622cc78e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:26.654697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a1883866-a3f7-4a72-a040-15c9622cc78e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:26.665456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1883866-a3f7-4a72-a040-15c9622cc78e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:26.666217 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1883866-a3f7-4a72-a040-15c9622cc78e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:26.667492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1883866-a3f7-4a72-a040-15c9622cc78e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:26.668204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1883866-a3f7-4a72-a040-15c9622cc78e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:26.732200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a1883866-a3f7-4a72-a040-15c9622cc78e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:26.740419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a1883866-a3f7-4a72-a040-15c9622cc78e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093493 Feb 21 01:02:26.741017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 488/1160] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:27.761435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-75468ff9-4823-4ac5-9cc9-0844ee2a8c27 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:27.762486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-75468ff9-4823-4ac5-9cc9-0844ee2a8c27 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:27.773430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75468ff9-4823-4ac5-9cc9-0844ee2a8c27 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:27.774171 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75468ff9-4823-4ac5-9cc9-0844ee2a8c27 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:27.775445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75468ff9-4823-4ac5-9cc9-0844ee2a8c27 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:27.776157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-75468ff9-4823-4ac5-9cc9-0844ee2a8c27 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:27.858333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-75468ff9-4823-4ac5-9cc9-0844ee2a8c27 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:27.866103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-75468ff9-4823-4ac5-9cc9-0844ee2a8c27 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.110948 Feb 21 01:02:27.866665 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 673/1161] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:28.886731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0d4e027c-b768-48f6-a75b-e0778bc18899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:28.887637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0d4e027c-b768-48f6-a75b-e0778bc18899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:28.895548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d4e027c-b768-48f6-a75b-e0778bc18899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:28.895994 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d4e027c-b768-48f6-a75b-e0778bc18899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:28.896812 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d4e027c-b768-48f6-a75b-e0778bc18899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:28.897230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d4e027c-b768-48f6-a75b-e0778bc18899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:28.959821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0d4e027c-b768-48f6-a75b-e0778bc18899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:28.970170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0d4e027c-b768-48f6-a75b-e0778bc18899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089497 Feb 21 01:02:28.971037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 489/1162] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:28 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:29.996563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e2c681e8-7ec1-4c39-a5ff-5680e0e8fde4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:29.997532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e2c681e8-7ec1-4c39-a5ff-5680e0e8fde4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:30.005928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2c681e8-7ec1-4c39-a5ff-5680e0e8fde4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:30.006365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2c681e8-7ec1-4c39-a5ff-5680e0e8fde4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:30.007131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2c681e8-7ec1-4c39-a5ff-5680e0e8fde4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:30.007548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2c681e8-7ec1-4c39-a5ff-5680e0e8fde4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:30.072338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e2c681e8-7ec1-4c39-a5ff-5680e0e8fde4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:30.080262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e2c681e8-7ec1-4c39-a5ff-5680e0e8fde4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089937 Feb 21 01:02:30.080864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 674/1163] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:29 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:31.101179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6eb8de07-8147-4b36-98c3-5660f8a4b28c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:31.102302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6eb8de07-8147-4b36-98c3-5660f8a4b28c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:31.112482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6eb8de07-8147-4b36-98c3-5660f8a4b28c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:31.112949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6eb8de07-8147-4b36-98c3-5660f8a4b28c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:31.113724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6eb8de07-8147-4b36-98c3-5660f8a4b28c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:31.114132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6eb8de07-8147-4b36-98c3-5660f8a4b28c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:31.174919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6eb8de07-8147-4b36-98c3-5660f8a4b28c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:31.182533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6eb8de07-8147-4b36-98c3-5660f8a4b28c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087777 Feb 21 01:02:31.183081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 490/1164] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:31 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:32.203515 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3787576e-4782-433d-8d21-e7657ad3ba8d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:32.204471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3787576e-4782-433d-8d21-e7657ad3ba8d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:32.215070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3787576e-4782-433d-8d21-e7657ad3ba8d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:32.215749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3787576e-4782-433d-8d21-e7657ad3ba8d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:32.217109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3787576e-4782-433d-8d21-e7657ad3ba8d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:32.218343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3787576e-4782-433d-8d21-e7657ad3ba8d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:32.292787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3787576e-4782-433d-8d21-e7657ad3ba8d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:32.300632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3787576e-4782-433d-8d21-e7657ad3ba8d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.103605 Feb 21 01:02:32.301220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 675/1165] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:32 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:33.321729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a4ee726d-a5b4-47d7-86fa-a9fe26fda5d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:33.322779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a4ee726d-a5b4-47d7-86fa-a9fe26fda5d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:33.332506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4ee726d-a5b4-47d7-86fa-a9fe26fda5d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:33.332955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4ee726d-a5b4-47d7-86fa-a9fe26fda5d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:33.333735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4ee726d-a5b4-47d7-86fa-a9fe26fda5d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:33.334165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4ee726d-a5b4-47d7-86fa-a9fe26fda5d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:33.393715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a4ee726d-a5b4-47d7-86fa-a9fe26fda5d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:33.402418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a4ee726d-a5b4-47d7-86fa-a9fe26fda5d3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086630 Feb 21 01:02:33.403262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 491/1166] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:33 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:34.423260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d856710d-98a3-4ded-8380-41f3e0a61813 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:34.424200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d856710d-98a3-4ded-8380-41f3e0a61813 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:34.433620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d856710d-98a3-4ded-8380-41f3e0a61813 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:34.434252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d856710d-98a3-4ded-8380-41f3e0a61813 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:34.435428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d856710d-98a3-4ded-8380-41f3e0a61813 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:34.436047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d856710d-98a3-4ded-8380-41f3e0a61813 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:34.498567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d856710d-98a3-4ded-8380-41f3e0a61813 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:34.506506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d856710d-98a3-4ded-8380-41f3e0a61813 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089474 Feb 21 01:02:34.507084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 676/1167] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:34 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:35.527423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1b04b548-46a9-4cb7-b236-6d84fdca3cdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:35.528478 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1b04b548-46a9-4cb7-b236-6d84fdca3cdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:35.539429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b04b548-46a9-4cb7-b236-6d84fdca3cdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:35.540175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b04b548-46a9-4cb7-b236-6d84fdca3cdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:35.541501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b04b548-46a9-4cb7-b236-6d84fdca3cdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:35.542206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b04b548-46a9-4cb7-b236-6d84fdca3cdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:35.604942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1b04b548-46a9-4cb7-b236-6d84fdca3cdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:35.614188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1b04b548-46a9-4cb7-b236-6d84fdca3cdd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093334 Feb 21 01:02:35.614784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 492/1168] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:35 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:36.635149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce69cb58-ae38-4dbf-9771-818af61c8bf7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:36.636167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce69cb58-ae38-4dbf-9771-818af61c8bf7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:36.646851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce69cb58-ae38-4dbf-9771-818af61c8bf7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:36.647587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce69cb58-ae38-4dbf-9771-818af61c8bf7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:36.648913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce69cb58-ae38-4dbf-9771-818af61c8bf7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:36.649627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce69cb58-ae38-4dbf-9771-818af61c8bf7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:36.715471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce69cb58-ae38-4dbf-9771-818af61c8bf7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:36.725591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce69cb58-ae38-4dbf-9771-818af61c8bf7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096901 Feb 21 01:02:36.726142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 677/1169] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:36 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:37.746723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-00d1df29-74f5-49a4-ab5a-ef260e1f4033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:37.747713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-00d1df29-74f5-49a4-ab5a-ef260e1f4033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:37.758350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-00d1df29-74f5-49a4-ab5a-ef260e1f4033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:37.759085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-00d1df29-74f5-49a4-ab5a-ef260e1f4033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:37.760366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-00d1df29-74f5-49a4-ab5a-ef260e1f4033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:37.761214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-00d1df29-74f5-49a4-ab5a-ef260e1f4033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:37.825139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-00d1df29-74f5-49a4-ab5a-ef260e1f4033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:37.832589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-00d1df29-74f5-49a4-ab5a-ef260e1f4033 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092231 Feb 21 01:02:37.833151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 493/1170] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:38.850434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-23845e9e-0787-4b23-a9ea-f2a5045c788d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:38.851043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-23845e9e-0787-4b23-a9ea-f2a5045c788d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:38.858224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23845e9e-0787-4b23-a9ea-f2a5045c788d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:38.858681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23845e9e-0787-4b23-a9ea-f2a5045c788d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:38.859516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23845e9e-0787-4b23-a9ea-f2a5045c788d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:38.859946 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23845e9e-0787-4b23-a9ea-f2a5045c788d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:38.920353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-23845e9e-0787-4b23-a9ea-f2a5045c788d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:38.928120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-23845e9e-0787-4b23-a9ea-f2a5045c788d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.081799 Feb 21 01:02:38.928737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 678/1171] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:38 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:39.949161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5b9d2ae9-2800-4d66-ad62-843b1f7e62c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:39.950103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5b9d2ae9-2800-4d66-ad62-843b1f7e62c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:39.959046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5b9d2ae9-2800-4d66-ad62-843b1f7e62c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:39.959490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5b9d2ae9-2800-4d66-ad62-843b1f7e62c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:39.960260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5b9d2ae9-2800-4d66-ad62-843b1f7e62c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:39.960719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5b9d2ae9-2800-4d66-ad62-843b1f7e62c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:40.028377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5b9d2ae9-2800-4d66-ad62-843b1f7e62c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:40.038400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5b9d2ae9-2800-4d66-ad62-843b1f7e62c2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095085 Feb 21 01:02:40.039169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 494/1172] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:39 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:41.062913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b10e87b5-469d-4647-8e54-7d361c498dc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:41.063896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b10e87b5-469d-4647-8e54-7d361c498dc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:41.070957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b10e87b5-469d-4647-8e54-7d361c498dc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:41.071396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b10e87b5-469d-4647-8e54-7d361c498dc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:41.072157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b10e87b5-469d-4647-8e54-7d361c498dc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:41.072702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b10e87b5-469d-4647-8e54-7d361c498dc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:41.145084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b10e87b5-469d-4647-8e54-7d361c498dc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:41.153241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b10e87b5-469d-4647-8e54-7d361c498dc5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096603 Feb 21 01:02:41.153807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 679/1173] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:42.173717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b34501d2-d03d-4ada-b05c-278fdc0cea4f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:42.174879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b34501d2-d03d-4ada-b05c-278fdc0cea4f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:42.182594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b34501d2-d03d-4ada-b05c-278fdc0cea4f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:42.183120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b34501d2-d03d-4ada-b05c-278fdc0cea4f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:42.184032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b34501d2-d03d-4ada-b05c-278fdc0cea4f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:42.184578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b34501d2-d03d-4ada-b05c-278fdc0cea4f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:42.257336 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b34501d2-d03d-4ada-b05c-278fdc0cea4f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:42.265442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b34501d2-d03d-4ada-b05c-278fdc0cea4f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097926 Feb 21 01:02:42.266013 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 495/1174] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:42 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:43.287314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1b72e2fa-a2a4-41aa-b2e6-c23a9cebcc70 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:43.288132 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1b72e2fa-a2a4-41aa-b2e6-c23a9cebcc70 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:43.296781 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b72e2fa-a2a4-41aa-b2e6-c23a9cebcc70 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:43.297365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b72e2fa-a2a4-41aa-b2e6-c23a9cebcc70 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:43.298379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b72e2fa-a2a4-41aa-b2e6-c23a9cebcc70 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:43.298952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b72e2fa-a2a4-41aa-b2e6-c23a9cebcc70 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:43.368029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1b72e2fa-a2a4-41aa-b2e6-c23a9cebcc70 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:43.375875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1b72e2fa-a2a4-41aa-b2e6-c23a9cebcc70 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095024 Feb 21 01:02:43.376440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 680/1175] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:43 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:44.396496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-42c2c16b-3a96-40e8-b6c7-69f04de4aa08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:44.397182 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-42c2c16b-3a96-40e8-b6c7-69f04de4aa08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:44.405226 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42c2c16b-3a96-40e8-b6c7-69f04de4aa08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:44.405784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42c2c16b-3a96-40e8-b6c7-69f04de4aa08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:44.406690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42c2c16b-3a96-40e8-b6c7-69f04de4aa08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:44.407193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42c2c16b-3a96-40e8-b6c7-69f04de4aa08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:44.474789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-42c2c16b-3a96-40e8-b6c7-69f04de4aa08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:44.482498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-42c2c16b-3a96-40e8-b6c7-69f04de4aa08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092076 Feb 21 01:02:44.483055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 496/1176] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:44 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:45.502820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-21cfa654-b7a5-484c-b466-cad4140ac3d4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:45.503849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-21cfa654-b7a5-484c-b466-cad4140ac3d4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:45.511813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-21cfa654-b7a5-484c-b466-cad4140ac3d4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:45.512307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-21cfa654-b7a5-484c-b466-cad4140ac3d4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:45.513214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-21cfa654-b7a5-484c-b466-cad4140ac3d4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:45.513687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-21cfa654-b7a5-484c-b466-cad4140ac3d4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:45.576245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-21cfa654-b7a5-484c-b466-cad4140ac3d4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:45.584299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-21cfa654-b7a5-484c-b466-cad4140ac3d4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087673 Feb 21 01:02:45.584915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 681/1177] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:45 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:46.605201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fa877e74-5ae7-47c3-8347-d7949230909e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:46.606209 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fa877e74-5ae7-47c3-8347-d7949230909e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:46.616136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa877e74-5ae7-47c3-8347-d7949230909e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:46.616625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa877e74-5ae7-47c3-8347-d7949230909e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:46.617400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa877e74-5ae7-47c3-8347-d7949230909e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:46.617828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa877e74-5ae7-47c3-8347-d7949230909e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:46.686701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fa877e74-5ae7-47c3-8347-d7949230909e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:46.694810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fa877e74-5ae7-47c3-8347-d7949230909e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095917 Feb 21 01:02:46.695379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 497/1178] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:46 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:47.715888 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b84edaad-74d3-408e-bce2-c6439469adce tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:47.716806 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b84edaad-74d3-408e-bce2-c6439469adce tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:47.726215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b84edaad-74d3-408e-bce2-c6439469adce tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:47.726661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b84edaad-74d3-408e-bce2-c6439469adce tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:47.727432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b84edaad-74d3-408e-bce2-c6439469adce tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:47.727859 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b84edaad-74d3-408e-bce2-c6439469adce tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:47.790976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b84edaad-74d3-408e-bce2-c6439469adce tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:47.799129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b84edaad-74d3-408e-bce2-c6439469adce tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089629 Feb 21 01:02:47.799708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 682/1179] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:48.820685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9f989e7f-ab21-402f-ab37-bf7f574628cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:48.821542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9f989e7f-ab21-402f-ab37-bf7f574628cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:48.832225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f989e7f-ab21-402f-ab37-bf7f574628cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:48.833019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f989e7f-ab21-402f-ab37-bf7f574628cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:48.833957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f989e7f-ab21-402f-ab37-bf7f574628cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:48.834389 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f989e7f-ab21-402f-ab37-bf7f574628cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:48.904919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9f989e7f-ab21-402f-ab37-bf7f574628cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:48.912754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9f989e7f-ab21-402f-ab37-bf7f574628cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.099021 Feb 21 01:02:48.913293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 498/1180] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:48 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:49.938027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c725ac14-d75d-4e8d-86ca-8e5f701e7678 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:49.939040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c725ac14-d75d-4e8d-86ca-8e5f701e7678 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:49.948601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c725ac14-d75d-4e8d-86ca-8e5f701e7678 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:49.949135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c725ac14-d75d-4e8d-86ca-8e5f701e7678 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:49.950481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c725ac14-d75d-4e8d-86ca-8e5f701e7678 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:49.950990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c725ac14-d75d-4e8d-86ca-8e5f701e7678 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:50.019702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c725ac14-d75d-4e8d-86ca-8e5f701e7678 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:50.029011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c725ac14-d75d-4e8d-86ca-8e5f701e7678 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097249 Feb 21 01:02:50.029570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 683/1181] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:49 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:51.051983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c1e6c22b-6d22-4a61-880c-4ede9e28c3dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:51.052985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c1e6c22b-6d22-4a61-880c-4ede9e28c3dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:51.059822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1e6c22b-6d22-4a61-880c-4ede9e28c3dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:51.060265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1e6c22b-6d22-4a61-880c-4ede9e28c3dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:51.061069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1e6c22b-6d22-4a61-880c-4ede9e28c3dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:51.061494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1e6c22b-6d22-4a61-880c-4ede9e28c3dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:51.121541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c1e6c22b-6d22-4a61-880c-4ede9e28c3dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:51.129407 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c1e6c22b-6d22-4a61-880c-4ede9e28c3dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083609 Feb 21 01:02:51.129977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 499/1182] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:52.149537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-688120e7-d482-4b5a-a402-f53d9784f1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:52.150525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-688120e7-d482-4b5a-a402-f53d9784f1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:52.161583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-688120e7-d482-4b5a-a402-f53d9784f1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:52.162313 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-688120e7-d482-4b5a-a402-f53d9784f1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:52.163308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-688120e7-d482-4b5a-a402-f53d9784f1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:52.163735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-688120e7-d482-4b5a-a402-f53d9784f1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:52.235670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-688120e7-d482-4b5a-a402-f53d9784f1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:52.244834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-688120e7-d482-4b5a-a402-f53d9784f1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.101484 Feb 21 01:02:52.245377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 684/1183] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:53.265767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-04ab5df2-21f3-494b-bf5f-00c8da1ceca3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:53.266724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-04ab5df2-21f3-494b-bf5f-00c8da1ceca3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:53.275588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04ab5df2-21f3-494b-bf5f-00c8da1ceca3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:53.276067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04ab5df2-21f3-494b-bf5f-00c8da1ceca3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:53.277250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04ab5df2-21f3-494b-bf5f-00c8da1ceca3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:53.277657 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04ab5df2-21f3-494b-bf5f-00c8da1ceca3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:53.339187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04ab5df2-21f3-494b-bf5f-00c8da1ceca3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:53.346752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-04ab5df2-21f3-494b-bf5f-00c8da1ceca3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087251 Feb 21 01:02:53.347318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 500/1184] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:53 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:54.362910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-249f864e-5260-435b-9955-df312c933e02 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:54.363525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-249f864e-5260-435b-9955-df312c933e02 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:54.369973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-249f864e-5260-435b-9955-df312c933e02 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:54.370411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-249f864e-5260-435b-9955-df312c933e02 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:54.371175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-249f864e-5260-435b-9955-df312c933e02 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:54.371600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-249f864e-5260-435b-9955-df312c933e02 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:54.435728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-249f864e-5260-435b-9955-df312c933e02 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:54.443337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-249f864e-5260-435b-9955-df312c933e02 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084100 Feb 21 01:02:54.444149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 685/1185] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:54 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:55.464015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9f9b48e4-63cb-4b8e-a71d-18840d26009d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:55.465050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9f9b48e4-63cb-4b8e-a71d-18840d26009d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:55.475531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f9b48e4-63cb-4b8e-a71d-18840d26009d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:55.475972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f9b48e4-63cb-4b8e-a71d-18840d26009d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:55.476772 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f9b48e4-63cb-4b8e-a71d-18840d26009d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:55.477200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f9b48e4-63cb-4b8e-a71d-18840d26009d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:55.538275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9f9b48e4-63cb-4b8e-a71d-18840d26009d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:55.546162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9f9b48e4-63cb-4b8e-a71d-18840d26009d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088334 Feb 21 01:02:55.546721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 501/1186] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:56.563215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-11465837-dfd5-424c-9436-0477e8af6c3d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:56.563824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-11465837-dfd5-424c-9436-0477e8af6c3d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:56.570678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11465837-dfd5-424c-9436-0477e8af6c3d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:56.571126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11465837-dfd5-424c-9436-0477e8af6c3d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:56.571909 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11465837-dfd5-424c-9436-0477e8af6c3d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:56.572329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11465837-dfd5-424c-9436-0477e8af6c3d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:56.631929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-11465837-dfd5-424c-9436-0477e8af6c3d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:56.639714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-11465837-dfd5-424c-9436-0477e8af6c3d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.080331 Feb 21 01:02:56.640279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 686/1187] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:57.661553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-141fa22c-ba74-45e9-938e-8f2d21e5a7c6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:57.662483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-141fa22c-ba74-45e9-938e-8f2d21e5a7c6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:57.670829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-141fa22c-ba74-45e9-938e-8f2d21e5a7c6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:57.671564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-141fa22c-ba74-45e9-938e-8f2d21e5a7c6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:57.672576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-141fa22c-ba74-45e9-938e-8f2d21e5a7c6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:57.673261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-141fa22c-ba74-45e9-938e-8f2d21e5a7c6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:57.749446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-141fa22c-ba74-45e9-938e-8f2d21e5a7c6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:57.757599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-141fa22c-ba74-45e9-938e-8f2d21e5a7c6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.102768 Feb 21 01:02:57.758160 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 502/1188] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:58.777886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2cc18c00-dbd2-4fe4-8034-86bca01754e6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:58.778664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2cc18c00-dbd2-4fe4-8034-86bca01754e6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:58.786758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2cc18c00-dbd2-4fe4-8034-86bca01754e6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:58.787349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2cc18c00-dbd2-4fe4-8034-86bca01754e6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:58.788352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2cc18c00-dbd2-4fe4-8034-86bca01754e6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:58.788975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2cc18c00-dbd2-4fe4-8034-86bca01754e6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:58.852178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2cc18c00-dbd2-4fe4-8034-86bca01754e6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:58.859707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2cc18c00-dbd2-4fe4-8034-86bca01754e6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087452 Feb 21 01:02:58.860253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 687/1189] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:58 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:02:59.881137 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6a65a88e-7cb7-40ed-a647-b15e85b15069 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:02:59.882008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6a65a88e-7cb7-40ed-a647-b15e85b15069 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:02:59.889458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a65a88e-7cb7-40ed-a647-b15e85b15069 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:59.889952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a65a88e-7cb7-40ed-a647-b15e85b15069 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:59.890884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a65a88e-7cb7-40ed-a647-b15e85b15069 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:02:59.891388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a65a88e-7cb7-40ed-a647-b15e85b15069 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:02:59.960264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6a65a88e-7cb7-40ed-a647-b15e85b15069 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:02:59.968114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6a65a88e-7cb7-40ed-a647-b15e85b15069 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093416 Feb 21 01:02:59.968792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 503/1190] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:02:59 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:00.991436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fc51c287-3b1e-43e4-b47a-97c68d8791c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:00.992027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fc51c287-3b1e-43e4-b47a-97c68d8791c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:00.998878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc51c287-3b1e-43e4-b47a-97c68d8791c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:00.999348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc51c287-3b1e-43e4-b47a-97c68d8791c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:01.000159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc51c287-3b1e-43e4-b47a-97c68d8791c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:01.000618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fc51c287-3b1e-43e4-b47a-97c68d8791c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:01.070186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fc51c287-3b1e-43e4-b47a-97c68d8791c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:01.078120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fc51c287-3b1e-43e4-b47a-97c68d8791c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093309 Feb 21 01:03:01.078689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 688/1191] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:02.097284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7486ce7e-4605-410f-8f15-58abfa7f6b6b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:02.098035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7486ce7e-4605-410f-8f15-58abfa7f6b6b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:02.105230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7486ce7e-4605-410f-8f15-58abfa7f6b6b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:02.105681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7486ce7e-4605-410f-8f15-58abfa7f6b6b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:02.106454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7486ce7e-4605-410f-8f15-58abfa7f6b6b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:02.106881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7486ce7e-4605-410f-8f15-58abfa7f6b6b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:02.173141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7486ce7e-4605-410f-8f15-58abfa7f6b6b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:02.181221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7486ce7e-4605-410f-8f15-58abfa7f6b6b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088441 Feb 21 01:03:02.181806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 504/1192] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:03.203795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0cf28f83-d066-4290-9095-42c762bde9a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:03.204857 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0cf28f83-d066-4290-9095-42c762bde9a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:03.214049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0cf28f83-d066-4290-9095-42c762bde9a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:03.214515 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0cf28f83-d066-4290-9095-42c762bde9a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:03.215284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0cf28f83-d066-4290-9095-42c762bde9a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:03.215713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0cf28f83-d066-4290-9095-42c762bde9a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:03.286375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0cf28f83-d066-4290-9095-42c762bde9a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:03.294527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0cf28f83-d066-4290-9095-42c762bde9a4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.098229 Feb 21 01:03:03.295115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 689/1193] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:03 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:04.315281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-04d0e545-bede-4699-9db7-accd5ddaca1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:04.316257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-04d0e545-bede-4699-9db7-accd5ddaca1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:04.324639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04d0e545-bede-4699-9db7-accd5ddaca1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:04.325085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04d0e545-bede-4699-9db7-accd5ddaca1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:04.325858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04d0e545-bede-4699-9db7-accd5ddaca1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:04.326287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04d0e545-bede-4699-9db7-accd5ddaca1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:04.386026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04d0e545-bede-4699-9db7-accd5ddaca1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:04.393556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-04d0e545-bede-4699-9db7-accd5ddaca1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084519 Feb 21 01:03:04.394126 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 505/1194] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:04 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:05.413978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e31b12d2-bd55-4ee2-a8b4-464263c60684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:05.414569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e31b12d2-bd55-4ee2-a8b4-464263c60684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:05.425107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e31b12d2-bd55-4ee2-a8b4-464263c60684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:05.425735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e31b12d2-bd55-4ee2-a8b4-464263c60684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:05.426327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e31b12d2-bd55-4ee2-a8b4-464263c60684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:05.426786 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e31b12d2-bd55-4ee2-a8b4-464263c60684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:05.486997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e31b12d2-bd55-4ee2-a8b4-464263c60684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:05.494970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e31b12d2-bd55-4ee2-a8b4-464263c60684 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086952 Feb 21 01:03:05.495551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 690/1195] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:05 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:06.515991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-53b25516-d464-4ed1-83e9-829fab0089b4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:06.517008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-53b25516-d464-4ed1-83e9-829fab0089b4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:06.528310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53b25516-d464-4ed1-83e9-829fab0089b4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:06.529781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53b25516-d464-4ed1-83e9-829fab0089b4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:06.530412 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53b25516-d464-4ed1-83e9-829fab0089b4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:06.531147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53b25516-d464-4ed1-83e9-829fab0089b4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:06.596687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53b25516-d464-4ed1-83e9-829fab0089b4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:06.604690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-53b25516-d464-4ed1-83e9-829fab0089b4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094978 Feb 21 01:03:06.605258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 506/1196] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:06 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:07.625516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-98d4a815-cace-40a5-8063-25081193d12e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:07.626358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-98d4a815-cace-40a5-8063-25081193d12e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:07.637299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98d4a815-cace-40a5-8063-25081193d12e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:07.638024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98d4a815-cace-40a5-8063-25081193d12e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:07.639279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98d4a815-cace-40a5-8063-25081193d12e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:07.639982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98d4a815-cace-40a5-8063-25081193d12e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:07.706427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-98d4a815-cace-40a5-8063-25081193d12e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:07.714036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-98d4a815-cace-40a5-8063-25081193d12e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094766 Feb 21 01:03:07.714600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 691/1197] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:07 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:08.730801 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c29620bb-afd7-4a53-8674-1bb7323ad26c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:08.731412 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c29620bb-afd7-4a53-8674-1bb7323ad26c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:08.738071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c29620bb-afd7-4a53-8674-1bb7323ad26c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:08.738519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c29620bb-afd7-4a53-8674-1bb7323ad26c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:08.739298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c29620bb-afd7-4a53-8674-1bb7323ad26c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:08.739724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c29620bb-afd7-4a53-8674-1bb7323ad26c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:08.801178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c29620bb-afd7-4a53-8674-1bb7323ad26c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:08.808682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c29620bb-afd7-4a53-8674-1bb7323ad26c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.081703 Feb 21 01:03:08.809244 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 507/1198] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:08 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:09.829571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e1955387-09e1-48a8-9c02-38399f9611cc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:09.830628 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e1955387-09e1-48a8-9c02-38399f9611cc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:09.839451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1955387-09e1-48a8-9c02-38399f9611cc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:09.839892 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1955387-09e1-48a8-9c02-38399f9611cc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:09.840703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1955387-09e1-48a8-9c02-38399f9611cc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:09.841129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1955387-09e1-48a8-9c02-38399f9611cc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:09.902498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e1955387-09e1-48a8-9c02-38399f9611cc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:09.910235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e1955387-09e1-48a8-9c02-38399f9611cc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086987 Feb 21 01:03:09.910802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 692/1199] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:09 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:10.931026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1406501b-9e55-48dd-a4c6-eb7a26867ef5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:10.931902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1406501b-9e55-48dd-a4c6-eb7a26867ef5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:10.942597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1406501b-9e55-48dd-a4c6-eb7a26867ef5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:10.943328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1406501b-9e55-48dd-a4c6-eb7a26867ef5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:10.944636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1406501b-9e55-48dd-a4c6-eb7a26867ef5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:10.945503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1406501b-9e55-48dd-a4c6-eb7a26867ef5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:11.005618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1406501b-9e55-48dd-a4c6-eb7a26867ef5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:11.013358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1406501b-9e55-48dd-a4c6-eb7a26867ef5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088729 Feb 21 01:03:11.013945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 508/1200] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:10 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:12.033646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a3e6b070-e46d-407e-bf4b-6a817488d791 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:12.034597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a3e6b070-e46d-407e-bf4b-6a817488d791 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:12.045264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3e6b070-e46d-407e-bf4b-6a817488d791 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:12.045994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3e6b070-e46d-407e-bf4b-6a817488d791 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:12.047263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3e6b070-e46d-407e-bf4b-6a817488d791 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:12.048196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3e6b070-e46d-407e-bf4b-6a817488d791 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:12.109722 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a3e6b070-e46d-407e-bf4b-6a817488d791 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:12.117677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a3e6b070-e46d-407e-bf4b-6a817488d791 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090128 Feb 21 01:03:12.118267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 693/1201] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:12 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:13.138413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4fa7eb76-a250-4219-830b-b8743941ceb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:13.139333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4fa7eb76-a250-4219-830b-b8743941ceb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:13.149904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4fa7eb76-a250-4219-830b-b8743941ceb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:13.150777 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4fa7eb76-a250-4219-830b-b8743941ceb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:13.152300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4fa7eb76-a250-4219-830b-b8743941ceb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:13.153078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4fa7eb76-a250-4219-830b-b8743941ceb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:13.217132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4fa7eb76-a250-4219-830b-b8743941ceb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:13.224908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4fa7eb76-a250-4219-830b-b8743941ceb4 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092691 Feb 21 01:03:13.225824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 509/1202] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:14.243384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fdd4d723-a34d-457d-94f9-83cd3c4415d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:14.243966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fdd4d723-a34d-457d-94f9-83cd3c4415d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:14.250850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd4d723-a34d-457d-94f9-83cd3c4415d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:14.251285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd4d723-a34d-457d-94f9-83cd3c4415d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:14.252036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd4d723-a34d-457d-94f9-83cd3c4415d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:14.252490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd4d723-a34d-457d-94f9-83cd3c4415d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:14.312959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fdd4d723-a34d-457d-94f9-83cd3c4415d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:14.320911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fdd4d723-a34d-457d-94f9-83cd3c4415d2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.081934 Feb 21 01:03:14.321473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 694/1203] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:15.339049 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b52fc6a2-7c63-445c-8663-33b179d988c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:15.339671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b52fc6a2-7c63-445c-8663-33b179d988c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:15.346742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b52fc6a2-7c63-445c-8663-33b179d988c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:15.347186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b52fc6a2-7c63-445c-8663-33b179d988c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:15.347992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b52fc6a2-7c63-445c-8663-33b179d988c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:15.348440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b52fc6a2-7c63-445c-8663-33b179d988c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:15.410691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b52fc6a2-7c63-445c-8663-33b179d988c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:15.418253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b52fc6a2-7c63-445c-8663-33b179d988c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083555 Feb 21 01:03:15.418806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 510/1204] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:16.442840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-421e37d7-e13d-43d4-a7b9-c9f8f425514a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:16.443806 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-421e37d7-e13d-43d4-a7b9-c9f8f425514a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:16.451288 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-421e37d7-e13d-43d4-a7b9-c9f8f425514a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:16.451729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-421e37d7-e13d-43d4-a7b9-c9f8f425514a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:16.452537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-421e37d7-e13d-43d4-a7b9-c9f8f425514a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:16.452970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-421e37d7-e13d-43d4-a7b9-c9f8f425514a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:16.518388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-421e37d7-e13d-43d4-a7b9-c9f8f425514a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:16.526923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-421e37d7-e13d-43d4-a7b9-c9f8f425514a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090003 Feb 21 01:03:16.527511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 695/1205] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:17.546549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4cd7516f-25cb-42aa-8003-90e9b71d704f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:17.547531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4cd7516f-25cb-42aa-8003-90e9b71d704f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:17.556826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4cd7516f-25cb-42aa-8003-90e9b71d704f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:17.557273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4cd7516f-25cb-42aa-8003-90e9b71d704f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:17.558047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4cd7516f-25cb-42aa-8003-90e9b71d704f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:17.558482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4cd7516f-25cb-42aa-8003-90e9b71d704f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:17.621874 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4cd7516f-25cb-42aa-8003-90e9b71d704f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:17.629720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4cd7516f-25cb-42aa-8003-90e9b71d704f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089431 Feb 21 01:03:17.630321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 511/1206] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:17 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:18.650669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f9799014-1aaa-4a2c-bdc0-e5dba1c2900d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:18.651998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f9799014-1aaa-4a2c-bdc0-e5dba1c2900d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:18.663334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f9799014-1aaa-4a2c-bdc0-e5dba1c2900d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:18.664510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f9799014-1aaa-4a2c-bdc0-e5dba1c2900d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:18.665361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f9799014-1aaa-4a2c-bdc0-e5dba1c2900d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:18.665934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f9799014-1aaa-4a2c-bdc0-e5dba1c2900d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:18.726271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f9799014-1aaa-4a2c-bdc0-e5dba1c2900d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:18.733792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f9799014-1aaa-4a2c-bdc0-e5dba1c2900d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089332 Feb 21 01:03:18.734355 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 696/1207] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:18 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:19.705232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:03:19.706268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:03:19.754170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-750f9dc6-031c-4881-8817-ca4ef3e49937 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:19.755170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-750f9dc6-031c-4881-8817-ca4ef3e49937 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:19.765770 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-750f9dc6-031c-4881-8817-ca4ef3e49937 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:19.766506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-750f9dc6-031c-4881-8817-ca4ef3e49937 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:19.767780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-750f9dc6-031c-4881-8817-ca4ef3e49937 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:19.768535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-750f9dc6-031c-4881-8817-ca4ef3e49937 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:19.831334 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-750f9dc6-031c-4881-8817-ca4ef3e49937 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:19.838982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-750f9dc6-031c-4881-8817-ca4ef3e49937 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090799 Feb 21 01:03:19.839541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 512/1208] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:19 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:20.860244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e3f0c5f7-2106-4dd2-8063-fdc01e4d50ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:20.861176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e3f0c5f7-2106-4dd2-8063-fdc01e4d50ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:20.871898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3f0c5f7-2106-4dd2-8063-fdc01e4d50ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:20.872695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3f0c5f7-2106-4dd2-8063-fdc01e4d50ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:20.873970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3f0c5f7-2106-4dd2-8063-fdc01e4d50ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:20.874694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3f0c5f7-2106-4dd2-8063-fdc01e4d50ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:20.942089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e3f0c5f7-2106-4dd2-8063-fdc01e4d50ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:20.950106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e3f0c5f7-2106-4dd2-8063-fdc01e4d50ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096129 Feb 21 01:03:20.950652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 697/1209] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:20 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:21.970837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-aff0e628-2a5e-4d32-92b7-91ef0a57f860 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:21.971828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-aff0e628-2a5e-4d32-92b7-91ef0a57f860 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:21.982363 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aff0e628-2a5e-4d32-92b7-91ef0a57f860 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:21.983093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aff0e628-2a5e-4d32-92b7-91ef0a57f860 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:21.984352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aff0e628-2a5e-4d32-92b7-91ef0a57f860 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:21.985118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aff0e628-2a5e-4d32-92b7-91ef0a57f860 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:22.047994 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-aff0e628-2a5e-4d32-92b7-91ef0a57f860 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:22.055487 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-aff0e628-2a5e-4d32-92b7-91ef0a57f860 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090839 Feb 21 01:03:22.056037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 513/1210] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:21 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:23.074003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9e98f029-c631-4711-85ed-974f83c85a10 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:23.074630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9e98f029-c631-4711-85ed-974f83c85a10 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:23.081282 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e98f029-c631-4711-85ed-974f83c85a10 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:23.081727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e98f029-c631-4711-85ed-974f83c85a10 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:23.082500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e98f029-c631-4711-85ed-974f83c85a10 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:23.082927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e98f029-c631-4711-85ed-974f83c85a10 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:23.155969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9e98f029-c631-4711-85ed-974f83c85a10 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:23.163741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9e98f029-c631-4711-85ed-974f83c85a10 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093984 Feb 21 01:03:23.164366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 698/1211] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:23 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:24.184765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d52ab442-a383-4ece-af38-f823ee78148d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:24.185758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d52ab442-a383-4ece-af38-f823ee78148d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:24.196383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d52ab442-a383-4ece-af38-f823ee78148d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:24.197127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d52ab442-a383-4ece-af38-f823ee78148d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:24.198459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d52ab442-a383-4ece-af38-f823ee78148d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:24.199167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d52ab442-a383-4ece-af38-f823ee78148d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:24.265974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d52ab442-a383-4ece-af38-f823ee78148d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:24.273586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d52ab442-a383-4ece-af38-f823ee78148d tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095114 Feb 21 01:03:24.274136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 514/1212] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:24 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:25.293732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b0b556a7-e3ba-46cf-b504-ebf3fc01948a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:25.294823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b0b556a7-e3ba-46cf-b504-ebf3fc01948a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:25.305800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0b556a7-e3ba-46cf-b504-ebf3fc01948a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:25.306532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0b556a7-e3ba-46cf-b504-ebf3fc01948a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:25.307788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0b556a7-e3ba-46cf-b504-ebf3fc01948a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:25.308544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0b556a7-e3ba-46cf-b504-ebf3fc01948a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:25.374397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b0b556a7-e3ba-46cf-b504-ebf3fc01948a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:25.382117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b0b556a7-e3ba-46cf-b504-ebf3fc01948a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094496 Feb 21 01:03:25.382771 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 699/1213] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:25 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:26.401236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7826c253-8728-4a2e-b08e-791bb44c81a9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:26.402239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7826c253-8728-4a2e-b08e-791bb44c81a9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:26.409901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7826c253-8728-4a2e-b08e-791bb44c81a9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:26.410430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7826c253-8728-4a2e-b08e-791bb44c81a9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:26.411335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7826c253-8728-4a2e-b08e-791bb44c81a9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:26.411821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7826c253-8728-4a2e-b08e-791bb44c81a9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:26.474805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7826c253-8728-4a2e-b08e-791bb44c81a9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:26.482479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7826c253-8728-4a2e-b08e-791bb44c81a9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087123 Feb 21 01:03:26.483037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 515/1214] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:03:27.501486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b0a0cda9-3c24-4a06-b137-c14a1f7a5552 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:27.502044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b0a0cda9-3c24-4a06-b137-c14a1f7a5552 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:27.511253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0a0cda9-3c24-4a06-b137-c14a1f7a5552 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:27.511689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0a0cda9-3c24-4a06-b137-c14a1f7a5552 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:27.512477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0a0cda9-3c24-4a06-b137-c14a1f7a5552 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:27.512907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b0a0cda9-3c24-4a06-b137-c14a1f7a5552 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:27.583368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b0a0cda9-3c24-4a06-b137-c14a1f7a5552 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:27.591320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b0a0cda9-3c24-4a06-b137-c14a1f7a5552 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095657 Feb 21 01:03:27.591836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 700/1215] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:28.608159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5c7e14a8-a815-4e26-aa5b-c1ecdf554651 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:28.608885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5c7e14a8-a815-4e26-aa5b-c1ecdf554651 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:28.615337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c7e14a8-a815-4e26-aa5b-c1ecdf554651 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:28.615849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c7e14a8-a815-4e26-aa5b-c1ecdf554651 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:28.616667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c7e14a8-a815-4e26-aa5b-c1ecdf554651 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:28.617100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c7e14a8-a815-4e26-aa5b-c1ecdf554651 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:28.651195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:28.652044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:28.658280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:28.658753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:28.659467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:28.659896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:28.685923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5c7e14a8-a815-4e26-aa5b-c1ecdf554651 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:28.688076 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5c7e14a8-a815-4e26-aa5b-c1ecdf554651 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083302 Feb 21 01:03:28.689098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 516/1216] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:28 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:28.700536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Going to try to terminate instance {{(pid=123098) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:03:28.762060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR oslo.messaging._drivers.impl_rabbit [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [c5697c03-d9a1-4ec2-a8e7-9b8ab16d6aa2] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:03:29.709252 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0c2bb0fd-911c-47d7-84e8-3ea84ca0b376 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:29.710114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0c2bb0fd-911c-47d7-84e8-3ea84ca0b376 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:29.719730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c2bb0fd-911c-47d7-84e8-3ea84ca0b376 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:29.720448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c2bb0fd-911c-47d7-84e8-3ea84ca0b376 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:29.721666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c2bb0fd-911c-47d7-84e8-3ea84ca0b376 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:29.722342 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c2bb0fd-911c-47d7-84e8-3ea84ca0b376 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:29.771773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [c5697c03-d9a1-4ec2-a8e7-9b8ab16d6aa2] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 36416. Feb 21 01:03:29.790818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0c2bb0fd-911c-47d7-84e8-3ea84ca0b376 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:29.793752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-93d9ec74-83ff-4951-a9f2-0ccdc05ab705 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 204 len: 0 microversion: 2.20 time: 1.146204 Feb 21 01:03:29.797554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 701/1217] 10.222.0.72 () {60 vars in 1279 bytes} [Mon Feb 21 01:03:28 2022] DELETE /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 0 bytes in 1147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:03:29.799574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0c2bb0fd-911c-47d7-84e8-3ea84ca0b376 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096387 Feb 21 01:03:29.800191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 517/1218] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:29 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:29.803158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:29.803869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:29.810104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:29.810548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:29.811336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:29.811756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:29.952689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:29.965081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:29.966494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:29.967652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4c7990f7-a015-4333-9c8d-55d27b8a9cb9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1802 microversion: 2.20 time: 0.168914 Feb 21 01:03:29.968211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 702/1219] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:30.817554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f51bcb35-aa1b-4120-b309-70bee2df985e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:30.817986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f51bcb35-aa1b-4120-b309-70bee2df985e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:30.825936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f51bcb35-aa1b-4120-b309-70bee2df985e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:30.826381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f51bcb35-aa1b-4120-b309-70bee2df985e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:30.827164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f51bcb35-aa1b-4120-b309-70bee2df985e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:30.827668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f51bcb35-aa1b-4120-b309-70bee2df985e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:30.913082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f51bcb35-aa1b-4120-b309-70bee2df985e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:30.923428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f51bcb35-aa1b-4120-b309-70bee2df985e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.109717 Feb 21 01:03:30.924332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 518/1220] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:30 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:30.986119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:30.986698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:30.993711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:30.994361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:30.995207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:30.995685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:31.128751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:31.137181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:31.138670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:31.139821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ad90fb64-7c1c-46f6-a574-cbc392de34ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1802 microversion: 2.20 time: 0.157515 Feb 21 01:03:31.140402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 703/1221] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:31.709190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-8da62adb-faea-4955-b58f-5357a28c5f2c req-7eb645b0-333c-487e-80fe-4767dcb7a1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5aa3b9a-864e-42ff-81ec-278e00ddd8be", "name": "network-vif-deleted", "tag": "d8dbce75-bbb2-4b0b-bc43-c864b59621e9"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:03:31.710570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:03:31.710570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:03:31.718008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-8da62adb-faea-4955-b58f-5357a28c5f2c req-7eb645b0-333c-487e-80fe-4767dcb7a1f5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:31.718454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-8da62adb-faea-4955-b58f-5357a28c5f2c req-7eb645b0-333c-487e-80fe-4767dcb7a1f5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:31.729414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-8da62adb-faea-4955-b58f-5357a28c5f2c req-7eb645b0-333c-487e-80fe-4767dcb7a1f5 service nova] Creating event network-vif-deleted:d8dbce75-bbb2-4b0b-bc43-c864b59621e9 for instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be on hv-cinder-81322 Feb 21 01:03:31.736177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-8da62adb-faea-4955-b58f-5357a28c5f2c req-7eb645b0-333c-487e-80fe-4767dcb7a1f5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030870 Feb 21 01:03:31.739936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 519/1222] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:03:31.942049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0edf44c4-c244-429b-9b6a-405083f3312e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:31.942570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0edf44c4-c244-429b-9b6a-405083f3312e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:31.948939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0edf44c4-c244-429b-9b6a-405083f3312e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:31.949377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0edf44c4-c244-429b-9b6a-405083f3312e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:31.950154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0edf44c4-c244-429b-9b6a-405083f3312e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:31.950580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0edf44c4-c244-429b-9b6a-405083f3312e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:32.010049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0edf44c4-c244-429b-9b6a-405083f3312e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:32.017735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0edf44c4-c244-429b-9b6a-405083f3312e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.079547 Feb 21 01:03:32.018448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 704/1223] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:31 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:32.158961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:32.159663 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:32.167414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:32.167865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:32.168670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:32.169103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:32.232286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:32.240986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:32.242449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:32.243618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7163aaed-2cbb-4b32-869e-4c5f02564d22 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089318 Feb 21 01:03:32.244317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 520/1224] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:33.039104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fddad99c-1fd1-40ff-87d6-d6986e2e7d12 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:33.040259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fddad99c-1fd1-40ff-87d6-d6986e2e7d12 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:33.051666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fddad99c-1fd1-40ff-87d6-d6986e2e7d12 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:33.052543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fddad99c-1fd1-40ff-87d6-d6986e2e7d12 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:33.053838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fddad99c-1fd1-40ff-87d6-d6986e2e7d12 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:33.054564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fddad99c-1fd1-40ff-87d6-d6986e2e7d12 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:33.119014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fddad99c-1fd1-40ff-87d6-d6986e2e7d12 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:33.126565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fddad99c-1fd1-40ff-87d6-d6986e2e7d12 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093983 Feb 21 01:03:33.127088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 705/1225] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:33 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:33.263964 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:33.264647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:33.272108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:33.272669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:33.273549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:33.274016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:33.337908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:33.346725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:33.348044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:33.349191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6c56943c-d511-4340-a4f5-16052df62fd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090331 Feb 21 01:03:33.350053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 521/1226] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:34.147557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-caf68ccf-817c-41db-bc41-816d2c12fd95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:34.148601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-caf68ccf-817c-41db-bc41-816d2c12fd95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:34.159721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf68ccf-817c-41db-bc41-816d2c12fd95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:34.160456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf68ccf-817c-41db-bc41-816d2c12fd95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:34.161875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf68ccf-817c-41db-bc41-816d2c12fd95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:34.162585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf68ccf-817c-41db-bc41-816d2c12fd95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:34.225775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-caf68ccf-817c-41db-bc41-816d2c12fd95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:34.234115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-caf68ccf-817c-41db-bc41-816d2c12fd95 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092855 Feb 21 01:03:34.234684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 706/1227] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:34 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:34.370649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:34.371673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:34.379376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:34.379839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:34.380684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:34.381129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:34.447246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:34.456077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:34.457595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:34.458723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7ed4e62d-f840-48e4-ae21-16990c8f40b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094462 Feb 21 01:03:34.459280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 522/1228] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:35.253518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e7386a39-50da-49f0-9ba4-e6e8d8d65a63 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:35.254137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e7386a39-50da-49f0-9ba4-e6e8d8d65a63 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:35.260705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7386a39-50da-49f0-9ba4-e6e8d8d65a63 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:35.261159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7386a39-50da-49f0-9ba4-e6e8d8d65a63 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:35.261929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7386a39-50da-49f0-9ba4-e6e8d8d65a63 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:35.262352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e7386a39-50da-49f0-9ba4-e6e8d8d65a63 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:35.331145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e7386a39-50da-49f0-9ba4-e6e8d8d65a63 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:35.339448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e7386a39-50da-49f0-9ba4-e6e8d8d65a63 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091188 Feb 21 01:03:35.340020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 707/1229] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:35 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:35.480867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:35.481862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:35.489836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:35.490283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:35.491064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:35.491485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:35.563222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:35.576105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:35.578512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:35.579866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4d526030-42fa-4486-938e-fea7ec6f0bca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.105434 Feb 21 01:03:35.580457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 523/1230] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:35 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:36.359301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f0688e3d-02bd-4f17-b25b-915fff3a8f04 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:36.360402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f0688e3d-02bd-4f17-b25b-915fff3a8f04 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:36.367397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f0688e3d-02bd-4f17-b25b-915fff3a8f04 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:36.367839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f0688e3d-02bd-4f17-b25b-915fff3a8f04 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:36.368678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f0688e3d-02bd-4f17-b25b-915fff3a8f04 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:36.369106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f0688e3d-02bd-4f17-b25b-915fff3a8f04 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:36.433710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f0688e3d-02bd-4f17-b25b-915fff3a8f04 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:36.444278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f0688e3d-02bd-4f17-b25b-915fff3a8f04 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.089732 Feb 21 01:03:36.445123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 708/1231] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:36 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:36.604747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:36.605420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:36.612903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:36.613318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:36.614172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:36.614645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:36.680680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:36.689619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:36.691171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:36.692290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-30ee9626-6ad2-496d-ad39-5078834f1652 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091848 Feb 21 01:03:36.692905 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 524/1232] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:36 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:37.462006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7c801831-0c35-42a8-885c-248895c1b2cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:37.462614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7c801831-0c35-42a8-885c-248895c1b2cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:37.469815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c801831-0c35-42a8-885c-248895c1b2cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:37.470395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c801831-0c35-42a8-885c-248895c1b2cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:37.471160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c801831-0c35-42a8-885c-248895c1b2cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:37.471587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c801831-0c35-42a8-885c-248895c1b2cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:37.534008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7c801831-0c35-42a8-885c-248895c1b2cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:37.541840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7c801831-0c35-42a8-885c-248895c1b2cf tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083650 Feb 21 01:03:37.542423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 709/1233] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:37.715136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:37.716018 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:37.726988 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:37.727724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:37.729056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:37.729759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:37.793325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:37.801816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:37.803285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:37.804420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9f8636b5-eeee-4929-bcff-6d1cc1546a1a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096008 Feb 21 01:03:37.804984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 525/1234] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:37 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:38.558884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f0d23c21-9ef7-4ce0-875a-e2a57670e8d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:38.559504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f0d23c21-9ef7-4ce0-875a-e2a57670e8d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:38.566200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f0d23c21-9ef7-4ce0-875a-e2a57670e8d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:38.566697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f0d23c21-9ef7-4ce0-875a-e2a57670e8d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:38.567474 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f0d23c21-9ef7-4ce0-875a-e2a57670e8d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:38.567898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f0d23c21-9ef7-4ce0-875a-e2a57670e8d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:38.627332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f0d23c21-9ef7-4ce0-875a-e2a57670e8d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:38.635423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f0d23c21-9ef7-4ce0-875a-e2a57670e8d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.080260 Feb 21 01:03:38.635989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 710/1235] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:38 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:38.826178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:38.826796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:38.837149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:38.837777 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:38.838894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:38.839537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:38.906402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:38.914962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:38.916491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:38.917619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-250c1cd2-5f18-4071-8969-6b08e54463b0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097862 Feb 21 01:03:38.918171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 526/1236] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:39.656019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c3783dc1-70e6-427d-a723-e658dc7aac99 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:39.656848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c3783dc1-70e6-427d-a723-e658dc7aac99 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:39.664351 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3783dc1-70e6-427d-a723-e658dc7aac99 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:39.665019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3783dc1-70e6-427d-a723-e658dc7aac99 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:39.665849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3783dc1-70e6-427d-a723-e658dc7aac99 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:39.666316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3783dc1-70e6-427d-a723-e658dc7aac99 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:39.729340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c3783dc1-70e6-427d-a723-e658dc7aac99 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:39.737568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c3783dc1-70e6-427d-a723-e658dc7aac99 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087136 Feb 21 01:03:39.738146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 711/1237] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:39 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:39.939581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:39.940532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:39.951202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:39.951955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:39.953298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:39.954009 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:40.014036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:40.022480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:40.024005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:40.025167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4438fa2f-35bd-4e3c-a837-703197b98308 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092166 Feb 21 01:03:40.025723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 527/1238] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:40.763760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-28c25fe7-8558-436c-b885-804493c78455 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:40.764785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-28c25fe7-8558-436c-b885-804493c78455 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:40.772577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-28c25fe7-8558-436c-b885-804493c78455 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:40.773017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-28c25fe7-8558-436c-b885-804493c78455 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:40.773781 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-28c25fe7-8558-436c-b885-804493c78455 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:40.774203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-28c25fe7-8558-436c-b885-804493c78455 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:40.841998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-28c25fe7-8558-436c-b885-804493c78455 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:40.853729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-28c25fe7-8558-436c-b885-804493c78455 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095862 Feb 21 01:03:40.854520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 712/1239] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:40 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:41.051795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:41.052815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:41.063811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:41.064284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:41.065122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:41.065554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:41.126753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:41.135076 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:41.136585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:41.137720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ea2ff7b2-5d06-44c6-9390-e5d6c9ae8ea2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092327 Feb 21 01:03:41.138278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 528/1240] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:41 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:41.874653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f386f859-c06d-4f15-acea-bcd76d7bb54e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:41.875534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f386f859-c06d-4f15-acea-bcd76d7bb54e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:41.882898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f386f859-c06d-4f15-acea-bcd76d7bb54e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:41.883358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f386f859-c06d-4f15-acea-bcd76d7bb54e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:41.884165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f386f859-c06d-4f15-acea-bcd76d7bb54e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:41.884656 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f386f859-c06d-4f15-acea-bcd76d7bb54e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:41.952692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f386f859-c06d-4f15-acea-bcd76d7bb54e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:41.960784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f386f859-c06d-4f15-acea-bcd76d7bb54e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092528 Feb 21 01:03:41.961350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 713/1241] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:42.159457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:42.160317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:42.171840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:42.172653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:42.173732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:42.174165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:42.244637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:42.253001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:42.254489 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:42.255619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b47d30b0-1ec0-42f5-b9a4-8ea6e84f1d7d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102473 Feb 21 01:03:42.256170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 529/1242] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:42.981659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eed03405-5bf2-4d8d-91bd-5e8327b05ffd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:42.982551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eed03405-5bf2-4d8d-91bd-5e8327b05ffd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:42.990745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eed03405-5bf2-4d8d-91bd-5e8327b05ffd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:42.991195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eed03405-5bf2-4d8d-91bd-5e8327b05ffd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:42.991967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eed03405-5bf2-4d8d-91bd-5e8327b05ffd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:42.992424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eed03405-5bf2-4d8d-91bd-5e8327b05ffd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:43.060943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eed03405-5bf2-4d8d-91bd-5e8327b05ffd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:43.068490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eed03405-5bf2-4d8d-91bd-5e8327b05ffd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093184 Feb 21 01:03:43.069044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 714/1243] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:42 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:43.277935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:43.279065 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:43.287158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:43.287607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:43.288414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:43.288857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:43.348967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:43.357589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:43.359285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:43.360452 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3b020755-9078-4388-abe5-ade393cfeb6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089333 Feb 21 01:03:43.361006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 530/1244] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:44.089054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-aa3036e7-4462-45cd-86f1-9eb285153a30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:44.090036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-aa3036e7-4462-45cd-86f1-9eb285153a30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:44.098706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa3036e7-4462-45cd-86f1-9eb285153a30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:44.099148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa3036e7-4462-45cd-86f1-9eb285153a30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:44.099927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa3036e7-4462-45cd-86f1-9eb285153a30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:44.100357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aa3036e7-4462-45cd-86f1-9eb285153a30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:44.166497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-aa3036e7-4462-45cd-86f1-9eb285153a30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:44.174191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-aa3036e7-4462-45cd-86f1-9eb285153a30 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091537 Feb 21 01:03:44.174758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 715/1245] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:44 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:44.382042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:44.382967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:44.393107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:44.393552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:44.394323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:44.394752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:44.457376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:44.465848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:44.467322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:44.468448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-45a41ec5-3970-4a92-9d92-2b081caa2bd7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092958 Feb 21 01:03:44.469018 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 531/1246] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:44 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:45.190083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c01f5ea3-d78c-4e02-a911-0cb21fb24759 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:45.190688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c01f5ea3-d78c-4e02-a911-0cb21fb24759 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:45.197432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c01f5ea3-d78c-4e02-a911-0cb21fb24759 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:45.197873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c01f5ea3-d78c-4e02-a911-0cb21fb24759 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:45.198653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c01f5ea3-d78c-4e02-a911-0cb21fb24759 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:45.199090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c01f5ea3-d78c-4e02-a911-0cb21fb24759 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:45.268954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c01f5ea3-d78c-4e02-a911-0cb21fb24759 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:45.277273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c01f5ea3-d78c-4e02-a911-0cb21fb24759 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091000 Feb 21 01:03:45.277831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 716/1247] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:45 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:45.490576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:45.491567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:45.502044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:45.502482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:45.503247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:45.503667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:45.563187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:45.571584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:45.573100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:45.574248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8e405b85-f290-45d0-aab1-c681e3901204 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090315 Feb 21 01:03:45.574804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 532/1248] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:45 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:46.298071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-44603706-c6dd-4054-8b56-326aea932bda tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:46.299175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-44603706-c6dd-4054-8b56-326aea932bda tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:46.309810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-44603706-c6dd-4054-8b56-326aea932bda tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:46.311501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-44603706-c6dd-4054-8b56-326aea932bda tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:46.312825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-44603706-c6dd-4054-8b56-326aea932bda tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:46.313529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-44603706-c6dd-4054-8b56-326aea932bda tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:46.376696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-44603706-c6dd-4054-8b56-326aea932bda tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:46.384939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-44603706-c6dd-4054-8b56-326aea932bda tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092956 Feb 21 01:03:46.385513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 717/1249] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:46 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:46.594527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:46.595455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:46.602849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:46.603341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:46.604218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:46.604726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:46.672154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:46.681186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:46.682764 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:46.683905 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-85955210-3d60-4c7f-90e2-551b99178bbc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095288 Feb 21 01:03:46.684584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 533/1250] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:47.407523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-17888e4d-f47b-45e0-a62b-8cd0b5631443 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:47.408127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-17888e4d-f47b-45e0-a62b-8cd0b5631443 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:47.414579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17888e4d-f47b-45e0-a62b-8cd0b5631443 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:47.415029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17888e4d-f47b-45e0-a62b-8cd0b5631443 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:47.415829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17888e4d-f47b-45e0-a62b-8cd0b5631443 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:47.416254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-17888e4d-f47b-45e0-a62b-8cd0b5631443 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:47.476520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-17888e4d-f47b-45e0-a62b-8cd0b5631443 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:47.484175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-17888e4d-f47b-45e0-a62b-8cd0b5631443 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.080446 Feb 21 01:03:47.484798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 718/1251] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:47.707235 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:47.707775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:47.714763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:47.715229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:47.715995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:47.716426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:47.780973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:47.789603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:47.791077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:47.792198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9ba54ed7-855b-4350-a9b2-297eaf8b88af tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090154 Feb 21 01:03:47.792792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 534/1252] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:47 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:48.505383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-401a12d6-00e3-4e0d-a83b-02a90dd39b16 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:48.506589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-401a12d6-00e3-4e0d-a83b-02a90dd39b16 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:48.517466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-401a12d6-00e3-4e0d-a83b-02a90dd39b16 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:48.518191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-401a12d6-00e3-4e0d-a83b-02a90dd39b16 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:48.519492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-401a12d6-00e3-4e0d-a83b-02a90dd39b16 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:48.520205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-401a12d6-00e3-4e0d-a83b-02a90dd39b16 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:48.586728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-401a12d6-00e3-4e0d-a83b-02a90dd39b16 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:48.594268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-401a12d6-00e3-4e0d-a83b-02a90dd39b16 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095164 Feb 21 01:03:48.594832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 719/1253] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:48 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:48.813521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:48.814198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:48.821150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:48.821594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:48.822388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:48.822789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:48.885447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:48.894247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:48.895725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:48.896880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3fe93c72-1242-413c-8d85-abf6cc8c87ae tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089706 Feb 21 01:03:48.897427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 535/1254] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:49.614083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-33ebe950-9e8c-4aac-b251-33da19b7824f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:49.614771 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-33ebe950-9e8c-4aac-b251-33da19b7824f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:49.622474 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33ebe950-9e8c-4aac-b251-33da19b7824f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:49.623018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33ebe950-9e8c-4aac-b251-33da19b7824f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:49.623934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33ebe950-9e8c-4aac-b251-33da19b7824f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:49.624451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-33ebe950-9e8c-4aac-b251-33da19b7824f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:49.687268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-33ebe950-9e8c-4aac-b251-33da19b7824f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:49.694792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-33ebe950-9e8c-4aac-b251-33da19b7824f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085973 Feb 21 01:03:49.695363 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 720/1255] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:49 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:49.919232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:49.920091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:49.928212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:49.928678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:49.929446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:49.929866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:49.989876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:49.998178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:49.999622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:50.000780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-df9dc3de-e881-4114-acf8-9f318b6dd485 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088002 Feb 21 01:03:50.001371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 536/1256] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:50.715320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-46520451-2feb-4803-830b-d59c76be4fbb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:50.716424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-46520451-2feb-4803-830b-d59c76be4fbb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:50.724903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46520451-2feb-4803-830b-d59c76be4fbb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:50.725347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46520451-2feb-4803-830b-d59c76be4fbb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:50.726153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46520451-2feb-4803-830b-d59c76be4fbb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:50.726580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46520451-2feb-4803-830b-d59c76be4fbb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:50.797641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-46520451-2feb-4803-830b-d59c76be4fbb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:50.805710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-46520451-2feb-4803-830b-d59c76be4fbb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096716 Feb 21 01:03:50.806300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 721/1257] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:50 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:51.022766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:51.023673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:51.033973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:51.034421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:51.035199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:51.035633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:51.115793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:51.129135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:51.131581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:51.133450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f862dd0d-a8b7-4332-a90b-1aa1fc0f4fdf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.116823 Feb 21 01:03:51.134390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 537/1258] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:51 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:51.827507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fdd1d521-a2da-42fd-b67a-92dc3a3e0d03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:51.828352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fdd1d521-a2da-42fd-b67a-92dc3a3e0d03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:51.839090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd1d521-a2da-42fd-b67a-92dc3a3e0d03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:51.839838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd1d521-a2da-42fd-b67a-92dc3a3e0d03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:51.841270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd1d521-a2da-42fd-b67a-92dc3a3e0d03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:51.841979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd1d521-a2da-42fd-b67a-92dc3a3e0d03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:51.906109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fdd1d521-a2da-42fd-b67a-92dc3a3e0d03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:51.917967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fdd1d521-a2da-42fd-b67a-92dc3a3e0d03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096649 Feb 21 01:03:51.918807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 722/1259] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:52.159521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:52.160371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:52.171104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:52.171841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:52.173181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:52.173828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:52.239969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:52.252309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:52.253819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:52.254951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1caaafdc-292e-4212-9f56-8597c7c852fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101867 Feb 21 01:03:52.255470 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 538/1260] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:52.944439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ee4d69bd-7413-415d-a87d-3ff33612a0bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:52.945477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ee4d69bd-7413-415d-a87d-3ff33612a0bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:52.956036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ee4d69bd-7413-415d-a87d-3ff33612a0bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:52.956507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ee4d69bd-7413-415d-a87d-3ff33612a0bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:52.957475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ee4d69bd-7413-415d-a87d-3ff33612a0bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:52.957903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ee4d69bd-7413-415d-a87d-3ff33612a0bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:53.022880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ee4d69bd-7413-415d-a87d-3ff33612a0bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:53.030673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ee4d69bd-7413-415d-a87d-3ff33612a0bb tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095396 Feb 21 01:03:53.031236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 723/1261] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:53.276410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:53.277056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:53.285975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:53.286420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:53.287212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:53.287639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:53.359303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:53.368786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:53.370268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:53.371394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7829b038-be59-47ff-b2b0-660a0a12c144 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101595 Feb 21 01:03:53.371945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 539/1262] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:53 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:54.051177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4d8f7661-5ee3-46c7-8e1a-0365098f183e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:54.051898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4d8f7661-5ee3-46c7-8e1a-0365098f183e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:54.061330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d8f7661-5ee3-46c7-8e1a-0365098f183e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:54.061965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d8f7661-5ee3-46c7-8e1a-0365098f183e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:54.063145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d8f7661-5ee3-46c7-8e1a-0365098f183e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:54.063767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d8f7661-5ee3-46c7-8e1a-0365098f183e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:54.127703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4d8f7661-5ee3-46c7-8e1a-0365098f183e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:54.139719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4d8f7661-5ee3-46c7-8e1a-0365098f183e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094344 Feb 21 01:03:54.140467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 724/1263] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:54 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:54.389616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:54.390589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:54.397280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:54.397794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:54.398637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:54.399066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:54.507220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:54.515830 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:54.517468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:54.518682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-94be9478-9240-4fbc-9ff1-f458ce2ed31a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.133117 Feb 21 01:03:54.519202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 540/1264] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:54 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:55.161430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d217fcab-7789-4296-a309-50d6f227d641 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:55.163096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d217fcab-7789-4296-a309-50d6f227d641 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:55.173801 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d217fcab-7789-4296-a309-50d6f227d641 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:55.174235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d217fcab-7789-4296-a309-50d6f227d641 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:55.175004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d217fcab-7789-4296-a309-50d6f227d641 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:55.175430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d217fcab-7789-4296-a309-50d6f227d641 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:55.241326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d217fcab-7789-4296-a309-50d6f227d641 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:55.253004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d217fcab-7789-4296-a309-50d6f227d641 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097718 Feb 21 01:03:55.253513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 725/1265] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:55.538056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:55.538650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:55.545533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:55.545988 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:55.546769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:55.547208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:55.613407 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:55.624946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:55.627267 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:55.629158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ec92eff-ecc7-4d68-a6d8-2dd4f764e5b1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094576 Feb 21 01:03:55.630001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 541/1266] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:56.273864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b242d2d8-be37-4c4c-a1f0-a951d7064e64 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:56.278013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b242d2d8-be37-4c4c-a1f0-a951d7064e64 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:56.286461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b242d2d8-be37-4c4c-a1f0-a951d7064e64 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:56.286907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b242d2d8-be37-4c4c-a1f0-a951d7064e64 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:56.287681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b242d2d8-be37-4c4c-a1f0-a951d7064e64 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:56.288106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b242d2d8-be37-4c4c-a1f0-a951d7064e64 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:56.349945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b242d2d8-be37-4c4c-a1f0-a951d7064e64 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:56.361539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b242d2d8-be37-4c4c-a1f0-a951d7064e64 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093895 Feb 21 01:03:56.362108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 726/1267] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:56.651825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:56.652864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:56.663533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:56.664270 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:56.665656 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:56.666642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:56.730676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:56.743344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:56.745702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:56.747462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-008c1dd8-a58f-48b7-89b3-52a22b67ed17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102138 Feb 21 01:03:56.748284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 542/1268] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:56 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:57.381799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9d15a00e-3375-40ae-b2fc-b6c736de8e1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:57.382593 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9d15a00e-3375-40ae-b2fc-b6c736de8e1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:57.390829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d15a00e-3375-40ae-b2fc-b6c736de8e1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:57.391353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d15a00e-3375-40ae-b2fc-b6c736de8e1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:57.392525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d15a00e-3375-40ae-b2fc-b6c736de8e1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:57.392971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d15a00e-3375-40ae-b2fc-b6c736de8e1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:57.453374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9d15a00e-3375-40ae-b2fc-b6c736de8e1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:57.461012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9d15a00e-3375-40ae-b2fc-b6c736de8e1f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085354 Feb 21 01:03:57.461581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 727/1269] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:57.772882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:57.774757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:57.784974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:57.785425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:57.786214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:57.786647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:57.852482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:57.861516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:57.862996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:57.864135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-870c7024-3a68-49fb-89a0-6e6b552b05fd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100167 Feb 21 01:03:57.864726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 543/1270] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:57 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:58.481609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f27496f1-ab8c-4816-a6d8-32b7c0cbec41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:58.482725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f27496f1-ab8c-4816-a6d8-32b7c0cbec41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:58.493640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f27496f1-ab8c-4816-a6d8-32b7c0cbec41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:58.494427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f27496f1-ab8c-4816-a6d8-32b7c0cbec41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:58.495708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f27496f1-ab8c-4816-a6d8-32b7c0cbec41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:58.496427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f27496f1-ab8c-4816-a6d8-32b7c0cbec41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:58.561094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f27496f1-ab8c-4816-a6d8-32b7c0cbec41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:58.569213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f27496f1-ab8c-4816-a6d8-32b7c0cbec41 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094020 Feb 21 01:03:58.569780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 728/1271] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:58 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:03:58.884784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:58.885494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:58.894062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:58.894520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:58.895305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:58.895827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:58.967898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:58.976976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:58.978481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:58.979629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9f796089-257a-47cd-82db-87d41432976b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100968 Feb 21 01:03:58.980183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 544/1272] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:03:59.589652 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-01b15ee3-5c79-4c9f-9e0b-cdcfb0f93705 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:03:59.590435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-01b15ee3-5c79-4c9f-9e0b-cdcfb0f93705 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:03:59.601216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01b15ee3-5c79-4c9f-9e0b-cdcfb0f93705 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:59.601880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01b15ee3-5c79-4c9f-9e0b-cdcfb0f93705 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:59.603095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01b15ee3-5c79-4c9f-9e0b-cdcfb0f93705 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:03:59.603726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-01b15ee3-5c79-4c9f-9e0b-cdcfb0f93705 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:03:59.677788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-01b15ee3-5c79-4c9f-9e0b-cdcfb0f93705 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:03:59.689797 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-01b15ee3-5c79-4c9f-9e0b-cdcfb0f93705 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.106038 Feb 21 01:03:59.690601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 729/1273] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:03:59 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:00.001703 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:00.002452 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:00.011142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:00.011735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:00.012809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:00.013381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:00.078944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:00.088061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:00.089589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:00.090756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f0254e2c-d6ab-41df-8191-c6c9e144f32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095416 Feb 21 01:04:00.091591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 545/1274] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:03:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:00.715174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-94ebffb1-8a47-4c4f-87ca-f5349fc51177 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:00.716199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-94ebffb1-8a47-4c4f-87ca-f5349fc51177 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:00.725113 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ebffb1-8a47-4c4f-87ca-f5349fc51177 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:00.725604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ebffb1-8a47-4c4f-87ca-f5349fc51177 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:00.726391 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ebffb1-8a47-4c4f-87ca-f5349fc51177 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:00.726856 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94ebffb1-8a47-4c4f-87ca-f5349fc51177 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:00.797019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-94ebffb1-8a47-4c4f-87ca-f5349fc51177 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:00.804561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-94ebffb1-8a47-4c4f-87ca-f5349fc51177 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095805 Feb 21 01:04:00.805135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 730/1275] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:01.112867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:01.113652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:01.123481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:01.124145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:01.125366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:01.126017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:01.191824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:01.200382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:01.201921 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:01.203090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-538450f2-2c90-43e8-9a72-7a2995586c80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096359 Feb 21 01:04:01.203642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 546/1276] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:01.825682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6cf7c954-07a2-46a2-b141-c85b01da9672 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:01.826517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6cf7c954-07a2-46a2-b141-c85b01da9672 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:01.834502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6cf7c954-07a2-46a2-b141-c85b01da9672 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:01.834931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6cf7c954-07a2-46a2-b141-c85b01da9672 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:01.835728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6cf7c954-07a2-46a2-b141-c85b01da9672 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:01.836145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6cf7c954-07a2-46a2-b141-c85b01da9672 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:01.899214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6cf7c954-07a2-46a2-b141-c85b01da9672 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:01.910442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6cf7c954-07a2-46a2-b141-c85b01da9672 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091051 Feb 21 01:04:01.911154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 731/1277] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:01 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:02.225234 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:02.226081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:02.236740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:02.237508 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:02.238781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:02.239495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:02.305715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:02.314667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:02.316150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:02.317318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1267454e-9559-4bad-b8f9-f2ed4cba0205 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098646 Feb 21 01:04:02.317883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 547/1278] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:02.930765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c872ec69-c66b-4a84-ae85-cd20a7629151 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:02.931602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c872ec69-c66b-4a84-ae85-cd20a7629151 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:02.941314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c872ec69-c66b-4a84-ae85-cd20a7629151 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:02.941754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c872ec69-c66b-4a84-ae85-cd20a7629151 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:02.942522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c872ec69-c66b-4a84-ae85-cd20a7629151 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:02.942938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c872ec69-c66b-4a84-ae85-cd20a7629151 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:03.004969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c872ec69-c66b-4a84-ae85-cd20a7629151 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:03.012379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c872ec69-c66b-4a84-ae85-cd20a7629151 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088007 Feb 21 01:04:03.012975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 732/1279] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:03.339610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:03.340643 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:03.351033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:03.351768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:03.353090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:03.353787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:03.427611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:03.436531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:03.438024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:03.439164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-913c5938-1d92-4954-a73c-099ebbbaf5a2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.105865 Feb 21 01:04:03.439732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 548/1280] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:04.033102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a2664fd7-d048-4115-8e23-bdf2899e8fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:04.033951 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a2664fd7-d048-4115-8e23-bdf2899e8fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:04.044624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2664fd7-d048-4115-8e23-bdf2899e8fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:04.045369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2664fd7-d048-4115-8e23-bdf2899e8fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:04.046684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2664fd7-d048-4115-8e23-bdf2899e8fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:04.047405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2664fd7-d048-4115-8e23-bdf2899e8fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:04.108754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a2664fd7-d048-4115-8e23-bdf2899e8fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:04.117260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a2664fd7-d048-4115-8e23-bdf2899e8fb0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090575 Feb 21 01:04:04.117830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 733/1281] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:04 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:04.459948 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:04.459948 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:04.468415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:04.469042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:04.469893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:04.470432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:04.533181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:04.541682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:04.543176 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:04.544327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2c9cef96-0e81-4f25-a7c0-f1637f35a386 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090771 Feb 21 01:04:04.544936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 549/1282] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:05.138076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-83ec1ec8-f851-435f-85fa-fd76bf8d9899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:05.139190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-83ec1ec8-f851-435f-85fa-fd76bf8d9899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:05.149948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83ec1ec8-f851-435f-85fa-fd76bf8d9899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:05.150681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83ec1ec8-f851-435f-85fa-fd76bf8d9899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:05.152614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83ec1ec8-f851-435f-85fa-fd76bf8d9899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:05.153327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83ec1ec8-f851-435f-85fa-fd76bf8d9899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:05.238953 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-83ec1ec8-f851-435f-85fa-fd76bf8d9899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:05.246822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-83ec1ec8-f851-435f-85fa-fd76bf8d9899 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.115087 Feb 21 01:04:05.247396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 734/1283] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:05 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:05.562458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:05.563095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:05.570001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:05.570453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:05.571212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:05.571642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:05.635493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:05.644127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:05.645646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:05.646781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ffcba88a-58dc-4093-bf5b-e29e40f7372f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088153 Feb 21 01:04:05.647333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 550/1284] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:06.266912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e859281e-5364-4ab3-8ef8-d6d3ca45293a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:06.267914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e859281e-5364-4ab3-8ef8-d6d3ca45293a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:06.277016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e859281e-5364-4ab3-8ef8-d6d3ca45293a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:06.277589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e859281e-5364-4ab3-8ef8-d6d3ca45293a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:06.278612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e859281e-5364-4ab3-8ef8-d6d3ca45293a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:06.279179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e859281e-5364-4ab3-8ef8-d6d3ca45293a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:06.352854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e859281e-5364-4ab3-8ef8-d6d3ca45293a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:06.360496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e859281e-5364-4ab3-8ef8-d6d3ca45293a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.099782 Feb 21 01:04:06.361186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 735/1285] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:06 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:06.669403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:06.670369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:06.681309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:06.682087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:06.683348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:06.684052 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:06.746157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:06.754636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:06.756131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:06.757266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-59d72f34-0e7a-4119-9f21-d672dbb18970 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094439 Feb 21 01:04:06.757915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 551/1286] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:06 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:07.380307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-22c2d782-c07b-4615-b0fa-f1a6c85e41dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:07.381030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-22c2d782-c07b-4615-b0fa-f1a6c85e41dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:07.387752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22c2d782-c07b-4615-b0fa-f1a6c85e41dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:07.388204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22c2d782-c07b-4615-b0fa-f1a6c85e41dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:07.389008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22c2d782-c07b-4615-b0fa-f1a6c85e41dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:07.389437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22c2d782-c07b-4615-b0fa-f1a6c85e41dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:07.450157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-22c2d782-c07b-4615-b0fa-f1a6c85e41dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:07.457813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-22c2d782-c07b-4615-b0fa-f1a6c85e41dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.082612 Feb 21 01:04:07.458389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 736/1287] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:07 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:07.779614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:07.780557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:07.791253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:07.792006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:07.793344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:07.794075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:07.855132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:07.863615 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:07.865178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:07.866300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9e39a710-c1bd-4366-9bd7-b243b2cdb943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093276 Feb 21 01:04:07.866855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 552/1288] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:07 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:08.478609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-aece3af4-3a67-4f72-a273-8963203476d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:08.479619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-aece3af4-3a67-4f72-a273-8963203476d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:08.489316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aece3af4-3a67-4f72-a273-8963203476d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:08.489758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aece3af4-3a67-4f72-a273-8963203476d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:08.490529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aece3af4-3a67-4f72-a273-8963203476d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:08.490963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aece3af4-3a67-4f72-a273-8963203476d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:08.552145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-aece3af4-3a67-4f72-a273-8963203476d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:08.560416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-aece3af4-3a67-4f72-a273-8963203476d9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087953 Feb 21 01:04:08.561744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 737/1289] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:08 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:08.888526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:08.889400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:08.899982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:08.901187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:08.902425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:08.903136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:08.970020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:08.980010 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:08.981533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:08.982685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-02d071de-fd28-42ea-bb0c-cded61e7ad10 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100762 Feb 21 01:04:08.983205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 553/1290] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:09.581518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-70ba1c7b-4ffe-4ec5-a164-a961452c6f69 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:09.582547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-70ba1c7b-4ffe-4ec5-a164-a961452c6f69 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:09.593194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-70ba1c7b-4ffe-4ec5-a164-a961452c6f69 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:09.593916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-70ba1c7b-4ffe-4ec5-a164-a961452c6f69 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:09.595178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-70ba1c7b-4ffe-4ec5-a164-a961452c6f69 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:09.595891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-70ba1c7b-4ffe-4ec5-a164-a961452c6f69 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:09.658404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-70ba1c7b-4ffe-4ec5-a164-a961452c6f69 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:09.667900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-70ba1c7b-4ffe-4ec5-a164-a961452c6f69 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092626 Feb 21 01:04:09.668711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 738/1291] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:09 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:10.005200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:10.006216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:10.016857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:10.017598 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:10.018877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:10.019766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:10.091653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:10.100026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:10.101544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:10.102670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ada5ad1d-153c-413a-b31f-aab12d3ee3a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103699 Feb 21 01:04:10.103218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 554/1292] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:10.688225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8a436f85-26b0-4ac1-bf25-27de46a05e07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:10.689300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8a436f85-26b0-4ac1-bf25-27de46a05e07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:10.700109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8a436f85-26b0-4ac1-bf25-27de46a05e07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:10.700899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8a436f85-26b0-4ac1-bf25-27de46a05e07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:10.702162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8a436f85-26b0-4ac1-bf25-27de46a05e07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:10.702866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8a436f85-26b0-4ac1-bf25-27de46a05e07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:10.772129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8a436f85-26b0-4ac1-bf25-27de46a05e07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:10.783078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8a436f85-26b0-4ac1-bf25-27de46a05e07 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100912 Feb 21 01:04:10.783743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 739/1293] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:10 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:11.125049 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:11.125956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:11.133992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:11.134439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:11.135219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:11.135650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:11.205594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:11.214254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:11.215753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:11.216935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4bbc475f-7d69-4af3-a69f-5f0d779aeac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098459 Feb 21 01:04:11.217486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 555/1294] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:11.808716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-348c485c-0a7b-4458-bf0a-369961e91b08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:11.809660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-348c485c-0a7b-4458-bf0a-369961e91b08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:11.819482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-348c485c-0a7b-4458-bf0a-369961e91b08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:11.819946 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-348c485c-0a7b-4458-bf0a-369961e91b08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:11.820757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-348c485c-0a7b-4458-bf0a-369961e91b08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:11.821181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-348c485c-0a7b-4458-bf0a-369961e91b08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:11.881471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-348c485c-0a7b-4458-bf0a-369961e91b08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:11.889739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-348c485c-0a7b-4458-bf0a-369961e91b08 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087380 Feb 21 01:04:11.890319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 740/1295] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:11 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:12.240718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:12.241694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:12.252469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:12.253225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:12.254497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:12.255203 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:12.460703 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:12.469147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:12.470619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:12.471738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2600baf6-6b3f-4324-84d6-aeb5e4b7b36f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.237488 Feb 21 01:04:12.472295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 556/1296] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:12.911383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ee20ce50-2f83-44c2-9c29-1941735761b6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:12.912242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ee20ce50-2f83-44c2-9c29-1941735761b6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:12.923003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ee20ce50-2f83-44c2-9c29-1941735761b6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:12.923783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ee20ce50-2f83-44c2-9c29-1941735761b6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:12.925098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ee20ce50-2f83-44c2-9c29-1941735761b6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:12.925804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ee20ce50-2f83-44c2-9c29-1941735761b6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:13.057405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ee20ce50-2f83-44c2-9c29-1941735761b6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:13.068572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ee20ce50-2f83-44c2-9c29-1941735761b6 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.163240 Feb 21 01:04:13.069317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 741/1297] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:12 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:13.490102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:13.490824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:13.497463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:13.498007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:13.498881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:13.499379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:13.571928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:13.580994 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:13.582237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:13.583546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dbc95a27-1f8a-4150-80c0-7b1d3b6777a0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097392 Feb 21 01:04:13.584071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 557/1298] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:14.091800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-38b55d86-eaf3-4ed2-8ab0-af6cd319a1ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:14.092535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-38b55d86-eaf3-4ed2-8ab0-af6cd319a1ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:14.100295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38b55d86-eaf3-4ed2-8ab0-af6cd319a1ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:14.100770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38b55d86-eaf3-4ed2-8ab0-af6cd319a1ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:14.101552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38b55d86-eaf3-4ed2-8ab0-af6cd319a1ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:14.101981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-38b55d86-eaf3-4ed2-8ab0-af6cd319a1ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:14.172136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-38b55d86-eaf3-4ed2-8ab0-af6cd319a1ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:14.179789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-38b55d86-eaf3-4ed2-8ab0-af6cd319a1ec tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092433 Feb 21 01:04:14.180363 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 742/1299] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:14.604778 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:14.605581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:14.614457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:14.615045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:14.616069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:14.616692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:14.684959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:14.693702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:14.695254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:14.696416 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1a4b9843-6b7b-4db9-8d4c-e61aed4a71e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097074 Feb 21 01:04:14.696972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 558/1300] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:15.196804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2a102b1f-d8ad-40d0-a1fd-6a930858e5ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:15.197403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2a102b1f-d8ad-40d0-a1fd-6a930858e5ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:15.203998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a102b1f-d8ad-40d0-a1fd-6a930858e5ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:15.204469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a102b1f-d8ad-40d0-a1fd-6a930858e5ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:15.205249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a102b1f-d8ad-40d0-a1fd-6a930858e5ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:15.205669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a102b1f-d8ad-40d0-a1fd-6a930858e5ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:15.266807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2a102b1f-d8ad-40d0-a1fd-6a930858e5ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:15.274720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2a102b1f-d8ad-40d0-a1fd-6a930858e5ff tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.081594 Feb 21 01:04:15.275280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 743/1301] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:15 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:15.718430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:15.719430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:15.730276 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:15.731026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:15.732293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:15.733016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:15.797043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:15.805945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:15.807426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:15.808580 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-eee910c9-21cf-4d00-9d5f-4c00032908a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096437 Feb 21 01:04:15.809153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 559/1302] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:16.295336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8f72bada-535d-4abe-b766-ada18d564cd0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:16.296286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8f72bada-535d-4abe-b766-ada18d564cd0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:16.306985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f72bada-535d-4abe-b766-ada18d564cd0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:16.307737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f72bada-535d-4abe-b766-ada18d564cd0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:16.309090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f72bada-535d-4abe-b766-ada18d564cd0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:16.309812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f72bada-535d-4abe-b766-ada18d564cd0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:16.374325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8f72bada-535d-4abe-b766-ada18d564cd0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:16.382622 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8f72bada-535d-4abe-b766-ada18d564cd0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093941 Feb 21 01:04:16.383182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 744/1303] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:16.830385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:16.831320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:16.839479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:16.839922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:16.840754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:16.841172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:16.901972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:16.910859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:16.912376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:16.913738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dda94abd-856d-4ae3-92f7-1d4df691680f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089749 Feb 21 01:04:16.914341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 560/1304] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:17.401757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4609a553-ea53-46fd-ab7d-ca35486edf78 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:17.402449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4609a553-ea53-46fd-ab7d-ca35486edf78 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:17.409019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4609a553-ea53-46fd-ab7d-ca35486edf78 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:17.409457 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4609a553-ea53-46fd-ab7d-ca35486edf78 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:17.410225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4609a553-ea53-46fd-ab7d-ca35486edf78 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:17.410656 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4609a553-ea53-46fd-ab7d-ca35486edf78 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:17.470109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4609a553-ea53-46fd-ab7d-ca35486edf78 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:17.477991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4609a553-ea53-46fd-ab7d-ca35486edf78 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.080570 Feb 21 01:04:17.478587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 745/1305] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:17 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:17.935670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:17.936705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:17.946131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:17.946573 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:17.947345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:17.947771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:18.017181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:18.026979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:18.028457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:18.029615 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9ce0cfb6-28fe-4bd3-8b55-37ddeaf5ba9e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100217 Feb 21 01:04:18.030197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 561/1306] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:17 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:18.496361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-34dbdfff-5e86-4178-938d-4c4a4f65b418 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:18.497078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-34dbdfff-5e86-4178-938d-4c4a4f65b418 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:18.504807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34dbdfff-5e86-4178-938d-4c4a4f65b418 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:18.505318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34dbdfff-5e86-4178-938d-4c4a4f65b418 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:18.506225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34dbdfff-5e86-4178-938d-4c4a4f65b418 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:18.506789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34dbdfff-5e86-4178-938d-4c4a4f65b418 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:18.567800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-34dbdfff-5e86-4178-938d-4c4a4f65b418 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:18.576295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-34dbdfff-5e86-4178-938d-4c4a4f65b418 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084296 Feb 21 01:04:18.577243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 746/1307] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:18 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:19.056099 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:19.056721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:19.063529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:19.063967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:19.064779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:19.065202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:19.133759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:19.143896 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:19.145471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:19.146637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-07f3d274-ca83-448f-ad7a-8c5c7780974a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095154 Feb 21 01:04:19.147160 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 562/1308] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:19.602973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce004bf5-ff21-4f60-8c5e-d60f7a6beb53 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:19.603939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce004bf5-ff21-4f60-8c5e-d60f7a6beb53 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:19.614589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce004bf5-ff21-4f60-8c5e-d60f7a6beb53 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:19.615321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce004bf5-ff21-4f60-8c5e-d60f7a6beb53 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:19.616368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce004bf5-ff21-4f60-8c5e-d60f7a6beb53 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:19.616821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce004bf5-ff21-4f60-8c5e-d60f7a6beb53 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:19.682508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce004bf5-ff21-4f60-8c5e-d60f7a6beb53 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:19.694302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce004bf5-ff21-4f60-8c5e-d60f7a6beb53 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097371 Feb 21 01:04:19.695064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 747/1309] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:19 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:20.175209 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:20.176216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:20.187100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:20.187830 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:20.189180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:20.189894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:20.257497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:20.266527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:20.268019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:20.269202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ed34cb45-ecf2-4e8b-b3c0-4d70b573e5d1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100236 Feb 21 01:04:20.269753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 563/1310] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:20.720597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cc710cfa-ed2e-496b-8484-5fe55f1c9bb3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:20.721659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cc710cfa-ed2e-496b-8484-5fe55f1c9bb3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:20.729787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc710cfa-ed2e-496b-8484-5fe55f1c9bb3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:20.730254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc710cfa-ed2e-496b-8484-5fe55f1c9bb3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:20.731060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc710cfa-ed2e-496b-8484-5fe55f1c9bb3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:20.731516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cc710cfa-ed2e-496b-8484-5fe55f1c9bb3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:20.800663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cc710cfa-ed2e-496b-8484-5fe55f1c9bb3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:20.808605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cc710cfa-ed2e-496b-8484-5fe55f1c9bb3 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094183 Feb 21 01:04:20.809167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 748/1311] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:20 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:21.291610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:21.292563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:21.303624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:21.304363 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:21.305175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:21.305606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:21.368787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:21.377627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:21.379160 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:21.380275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-49941eb5-e39e-4e16-a21f-3338ebf5ec56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094964 Feb 21 01:04:21.380876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 564/1312] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:21.829258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a6dd53f8-820a-4b58-a372-8707958cd9bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:21.830270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a6dd53f8-820a-4b58-a372-8707958cd9bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:21.838846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a6dd53f8-820a-4b58-a372-8707958cd9bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:21.839284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a6dd53f8-820a-4b58-a372-8707958cd9bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:21.840064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a6dd53f8-820a-4b58-a372-8707958cd9bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:21.840601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a6dd53f8-820a-4b58-a372-8707958cd9bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:21.909714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a6dd53f8-820a-4b58-a372-8707958cd9bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:21.917268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a6dd53f8-820a-4b58-a372-8707958cd9bd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094198 Feb 21 01:04:21.917836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 749/1313] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:21 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:22.403981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:22.404946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:22.415011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:22.415453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:22.416233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:22.416692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:22.477355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:22.487972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:22.489522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:22.490684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-340735ac-993e-44f8-b18f-e097b9f0c504 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094757 Feb 21 01:04:22.491289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 565/1314] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:22.937317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-419acbf2-f70a-487a-a00e-ccd1f54177ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:22.938284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-419acbf2-f70a-487a-a00e-ccd1f54177ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:22.947435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-419acbf2-f70a-487a-a00e-ccd1f54177ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:22.947875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-419acbf2-f70a-487a-a00e-ccd1f54177ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:22.948740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-419acbf2-f70a-487a-a00e-ccd1f54177ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:22.949166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-419acbf2-f70a-487a-a00e-ccd1f54177ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:23.019574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-419acbf2-f70a-487a-a00e-ccd1f54177ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:23.028076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-419acbf2-f70a-487a-a00e-ccd1f54177ed tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097088 Feb 21 01:04:23.028757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 750/1315] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:22 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:23.508789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:23.509387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:23.516198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:23.516678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:23.517450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:23.517901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:23.579265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:23.588087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:23.589600 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:23.590745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-77b77bd7-7ed4-4c7b-a05a-60dcf071b44b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085755 Feb 21 01:04:23.591297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 566/1316] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:24.051217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6e50546c-3dab-4944-913e-b4a2a8a9c606 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:24.052174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6e50546c-3dab-4944-913e-b4a2a8a9c606 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:24.060046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e50546c-3dab-4944-913e-b4a2a8a9c606 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:24.060585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e50546c-3dab-4944-913e-b4a2a8a9c606 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:24.061393 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e50546c-3dab-4944-913e-b4a2a8a9c606 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:24.061838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e50546c-3dab-4944-913e-b4a2a8a9c606 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:24.131311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6e50546c-3dab-4944-913e-b4a2a8a9c606 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:24.139271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6e50546c-3dab-4944-913e-b4a2a8a9c606 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094273 Feb 21 01:04:24.139844 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 751/1317] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:24 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:24.612835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:24.613828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:24.624677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:24.625413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:24.626699 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:24.627402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:24.693410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:24.711550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:24.714127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:24.715266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-72b96d62-83bc-4942-8ec3-0fbd3891aa5f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.108969 Feb 21 01:04:24.716033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 567/1318] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:25.163868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-30ba946d-b4a8-43c4-84b1-70b72925f5b5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:25.164852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-30ba946d-b4a8-43c4-84b1-70b72925f5b5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:25.175574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30ba946d-b4a8-43c4-84b1-70b72925f5b5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:25.176308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30ba946d-b4a8-43c4-84b1-70b72925f5b5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:25.177637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30ba946d-b4a8-43c4-84b1-70b72925f5b5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:25.178350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30ba946d-b4a8-43c4-84b1-70b72925f5b5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:25.250328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-30ba946d-b4a8-43c4-84b1-70b72925f5b5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:25.258009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-30ba946d-b4a8-43c4-84b1-70b72925f5b5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100107 Feb 21 01:04:25.258546 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 752/1319] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:25 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:25.738631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:25.739673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:25.747867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:25.748374 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:25.749462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:25.749947 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:25.822910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:25.835937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:25.838372 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:25.839974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7505c588-5f0d-4f4c-a5ea-16c486f2589f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.107253 Feb 21 01:04:25.840818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 568/1320] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:26.277710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d04d98ab-b6f8-4d18-af1b-f7e34b86f8c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:26.278708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d04d98ab-b6f8-4d18-af1b-f7e34b86f8c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:26.289295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d04d98ab-b6f8-4d18-af1b-f7e34b86f8c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:26.290030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d04d98ab-b6f8-4d18-af1b-f7e34b86f8c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:26.291333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d04d98ab-b6f8-4d18-af1b-f7e34b86f8c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:26.291975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d04d98ab-b6f8-4d18-af1b-f7e34b86f8c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:26.356428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d04d98ab-b6f8-4d18-af1b-f7e34b86f8c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:26.364060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d04d98ab-b6f8-4d18-af1b-f7e34b86f8c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092633 Feb 21 01:04:26.364645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 753/1321] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:26 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:26.863404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:26.863983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:26.873092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:26.873732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:26.874838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:26.875374 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:26.945525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:26.954073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:26.955584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:26.956726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5f3eb9d5-b5d1-4c1e-a870-eb3c2b8b097f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098015 Feb 21 01:04:26.957307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 569/1322] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:27.384911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9e22d91a-f848-40e8-9de7-e0b865fb28a7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:27.385525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9e22d91a-f848-40e8-9de7-e0b865fb28a7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:27.392360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e22d91a-f848-40e8-9de7-e0b865fb28a7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:27.392865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e22d91a-f848-40e8-9de7-e0b865fb28a7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:27.393702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e22d91a-f848-40e8-9de7-e0b865fb28a7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:27.394154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e22d91a-f848-40e8-9de7-e0b865fb28a7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:27.457442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9e22d91a-f848-40e8-9de7-e0b865fb28a7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:27.465005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9e22d91a-f848-40e8-9de7-e0b865fb28a7 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085937 Feb 21 01:04:27.465584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 754/1323] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:27 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:27.978604 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:27.979559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:27.990194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:27.990927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:27.992189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:27.992955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:28.052777 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:28.061223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:28.062697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:28.063822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-628f4de9-ece8-492f-8f29-01f54325dd48 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091494 Feb 21 01:04:28.064429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 570/1324] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:28.485121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a797435d-6cda-4665-804b-b156e02cf8da tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:28.485687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a797435d-6cda-4665-804b-b156e02cf8da tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:28.494423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a797435d-6cda-4665-804b-b156e02cf8da tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:28.494878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a797435d-6cda-4665-804b-b156e02cf8da tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:28.495650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a797435d-6cda-4665-804b-b156e02cf8da tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:28.496080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a797435d-6cda-4665-804b-b156e02cf8da tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:28.563980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a797435d-6cda-4665-804b-b156e02cf8da tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:28.572036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a797435d-6cda-4665-804b-b156e02cf8da tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092902 Feb 21 01:04:28.572637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 755/1325] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:28 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:29.086112 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:29.087228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:29.097550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:29.098245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:29.099614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:29.100323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:29.170536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:29.183362 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:29.184887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:29.186026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-eae76d16-9ac9-4de1-bb79-c0a0091c376f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.106584 Feb 21 01:04:29.186590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 571/1326] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:29.593106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d684570f-4156-432e-9ece-82568f9d718f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:29.594049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d684570f-4156-432e-9ece-82568f9d718f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:29.604692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d684570f-4156-432e-9ece-82568f9d718f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:29.605133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d684570f-4156-432e-9ece-82568f9d718f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:29.605898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d684570f-4156-432e-9ece-82568f9d718f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:29.606321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d684570f-4156-432e-9ece-82568f9d718f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:29.665516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d684570f-4156-432e-9ece-82568f9d718f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:29.673467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d684570f-4156-432e-9ece-82568f9d718f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086644 Feb 21 01:04:29.674031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 756/1327] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:29 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:30.211463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:30.212152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:30.219992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:30.220551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:30.221449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:30.221953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:30.305501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:30.318343 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:30.320742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:30.322536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1ec37e8b-2b5e-47a1-8c6e-26b84a0b9806 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.115392 Feb 21 01:04:30.323281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 572/1328] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:30.694566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7a4dea70-f466-44c3-b0f9-e573cb90cfe5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:30.695564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7a4dea70-f466-44c3-b0f9-e573cb90cfe5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:30.706176 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a4dea70-f466-44c3-b0f9-e573cb90cfe5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:30.706900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a4dea70-f466-44c3-b0f9-e573cb90cfe5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:30.708159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a4dea70-f466-44c3-b0f9-e573cb90cfe5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:30.708918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a4dea70-f466-44c3-b0f9-e573cb90cfe5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:30.773028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7a4dea70-f466-44c3-b0f9-e573cb90cfe5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:30.783851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7a4dea70-f466-44c3-b0f9-e573cb90cfe5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095069 Feb 21 01:04:30.784565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 757/1329] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:30 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:31.340054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:31.340762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:31.347455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:31.347909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:31.348724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:31.349151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:31.410492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:31.419208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:31.420806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:31.422056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-827865dc-3b5d-4bf4-b5c8-faf2396a5da5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085799 Feb 21 01:04:31.422689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 573/1330] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:31.804910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f7cb2524-28d0-4fb1-b8f3-257d7c91b586 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:31.805896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f7cb2524-28d0-4fb1-b8f3-257d7c91b586 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:31.816483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f7cb2524-28d0-4fb1-b8f3-257d7c91b586 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:31.817265 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f7cb2524-28d0-4fb1-b8f3-257d7c91b586 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:31.818535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f7cb2524-28d0-4fb1-b8f3-257d7c91b586 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:31.819245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f7cb2524-28d0-4fb1-b8f3-257d7c91b586 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:31.886200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f7cb2524-28d0-4fb1-b8f3-257d7c91b586 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:31.894211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f7cb2524-28d0-4fb1-b8f3-257d7c91b586 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095614 Feb 21 01:04:31.894785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 758/1331] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:31 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:32.443149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:32.444132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:32.453494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:32.453944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:32.454733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:32.455157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:32.520258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:32.529568 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:32.531109 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:32.532254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fe2aa43e-e8a5-4f81-91da-c5b96dd783a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095497 Feb 21 01:04:32.532827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 574/1332] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:32.915029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-84665a83-154b-4694-bea3-5dfde6db262c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:32.916186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-84665a83-154b-4694-bea3-5dfde6db262c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:32.927152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84665a83-154b-4694-bea3-5dfde6db262c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:32.927898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84665a83-154b-4694-bea3-5dfde6db262c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:32.929251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84665a83-154b-4694-bea3-5dfde6db262c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:32.929976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-84665a83-154b-4694-bea3-5dfde6db262c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:32.996916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-84665a83-154b-4694-bea3-5dfde6db262c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:33.005035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-84665a83-154b-4694-bea3-5dfde6db262c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096208 Feb 21 01:04:33.005608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 759/1333] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:32 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:33.553267 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:33.553934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:33.560680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:33.561129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:33.561900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:33.562329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:33.623249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:33.631967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:33.633417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:33.634550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d2585dcf-2399-49bc-afb5-16afa70d87c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085195 Feb 21 01:04:33.635103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 575/1334] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:34.025833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ebaee4f6-fb28-42c9-811c-d07cacde5137 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:34.026796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ebaee4f6-fb28-42c9-811c-d07cacde5137 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:34.036241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ebaee4f6-fb28-42c9-811c-d07cacde5137 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:34.036709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ebaee4f6-fb28-42c9-811c-d07cacde5137 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:34.037479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ebaee4f6-fb28-42c9-811c-d07cacde5137 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:34.037901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ebaee4f6-fb28-42c9-811c-d07cacde5137 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:34.098698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ebaee4f6-fb28-42c9-811c-d07cacde5137 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:34.106447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ebaee4f6-fb28-42c9-811c-d07cacde5137 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087260 Feb 21 01:04:34.107016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 760/1335] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:34 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:34.661723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:34.662649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:34.673879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:34.674691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:34.675960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:34.676716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:34.746968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:34.755799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:34.757320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:34.758468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b8b49126-2892-4f30-a2d1-91ee30ea3902 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103091 Feb 21 01:04:34.759037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 576/1336] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:35.126820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-09f635b1-c51c-47c9-b5b6-78823ad56915 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:35.128014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-09f635b1-c51c-47c9-b5b6-78823ad56915 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:35.138581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-09f635b1-c51c-47c9-b5b6-78823ad56915 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:35.139326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-09f635b1-c51c-47c9-b5b6-78823ad56915 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:35.140645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-09f635b1-c51c-47c9-b5b6-78823ad56915 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:35.141358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-09f635b1-c51c-47c9-b5b6-78823ad56915 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:35.205222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-09f635b1-c51c-47c9-b5b6-78823ad56915 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:35.213035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-09f635b1-c51c-47c9-b5b6-78823ad56915 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092387 Feb 21 01:04:35.213612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 761/1337] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:35 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:35.780073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:35.781175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:35.791859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:35.792671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:35.793959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:35.794682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:35.858896 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:35.869262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:35.870775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:35.871911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a4296bbc-5ec3-4c34-9eb5-889403b4a4c0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098456 Feb 21 01:04:35.872505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 577/1338] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:35 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:36.234452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d585140c-1104-45a5-958f-2f5bfe497943 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:36.235278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d585140c-1104-45a5-958f-2f5bfe497943 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:36.246040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d585140c-1104-45a5-958f-2f5bfe497943 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:36.246829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d585140c-1104-45a5-958f-2f5bfe497943 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:36.248080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d585140c-1104-45a5-958f-2f5bfe497943 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:36.248850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d585140c-1104-45a5-958f-2f5bfe497943 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:36.313162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d585140c-1104-45a5-958f-2f5bfe497943 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:36.321106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d585140c-1104-45a5-958f-2f5bfe497943 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093087 Feb 21 01:04:36.321670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 762/1339] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:36 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:36.899526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:36.900848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:36.911603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:36.912357 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:36.913689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:36.914404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:36.980023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:36.988965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:36.990492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:36.991633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a5424fc6-4dc9-46c2-9076-52252b98970f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098894 Feb 21 01:04:36.992188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 578/1340] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:36 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:37.342215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f543c208-ad8f-4bfa-aa79-182767442a49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:37.343183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f543c208-ad8f-4bfa-aa79-182767442a49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:37.351972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f543c208-ad8f-4bfa-aa79-182767442a49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:37.352426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f543c208-ad8f-4bfa-aa79-182767442a49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:37.353221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f543c208-ad8f-4bfa-aa79-182767442a49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:37.353648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f543c208-ad8f-4bfa-aa79-182767442a49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:37.416215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f543c208-ad8f-4bfa-aa79-182767442a49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:37.423880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f543c208-ad8f-4bfa-aa79-182767442a49 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088016 Feb 21 01:04:37.424454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 763/1341] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:37 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:38.013396 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:38.014398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:38.025663 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:38.026415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:38.027685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:38.028432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:38.091703 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:38.100318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:38.101841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:38.102968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b904a572-980a-4833-a142-917e9caed8e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095858 Feb 21 01:04:38.103523 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 579/1342] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:38.441185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-376f3111-16a2-4ab8-b73f-c3b05e419923 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:38.441750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-376f3111-16a2-4ab8-b73f-c3b05e419923 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:38.449581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-376f3111-16a2-4ab8-b73f-c3b05e419923 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:38.450025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-376f3111-16a2-4ab8-b73f-c3b05e419923 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:38.451219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-376f3111-16a2-4ab8-b73f-c3b05e419923 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:38.451984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-376f3111-16a2-4ab8-b73f-c3b05e419923 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:38.521158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-376f3111-16a2-4ab8-b73f-c3b05e419923 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:38.529492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-376f3111-16a2-4ab8-b73f-c3b05e419923 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092134 Feb 21 01:04:38.530024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 764/1343] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:38 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:39.124454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:39.125495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:39.136064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:39.136847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:39.138154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:39.138821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:39.212674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:39.225284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:39.227537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:39.229354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1bb3498e-6ade-4f00-8100-ae1040fb4218 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.110775 Feb 21 01:04:39.230104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 580/1344] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:39.546428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cd07725a-0ea4-437f-929c-e9c3265b020e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:39.547034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cd07725a-0ea4-437f-929c-e9c3265b020e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:39.553803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cd07725a-0ea4-437f-929c-e9c3265b020e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:39.554239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cd07725a-0ea4-437f-929c-e9c3265b020e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:39.555006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cd07725a-0ea4-437f-929c-e9c3265b020e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:39.555427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cd07725a-0ea4-437f-929c-e9c3265b020e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:39.614735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cd07725a-0ea4-437f-929c-e9c3265b020e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:39.622215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cd07725a-0ea4-437f-929c-e9c3265b020e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.079532 Feb 21 01:04:39.622837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 765/1345] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:39 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:40.251548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:40.252680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:40.261537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:40.261985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:40.262751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:40.263189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:40.327922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:40.336571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:40.338033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:40.339153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-16d94ee0-5bec-457a-b4b3-90631520aa99 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093963 Feb 21 01:04:40.339717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 581/1346] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:40 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:40.639529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fe78766e-e8ac-42a8-b0b2-5c640db7ee5c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:40.640162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fe78766e-e8ac-42a8-b0b2-5c640db7ee5c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:40.648705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe78766e-e8ac-42a8-b0b2-5c640db7ee5c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:40.649149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe78766e-e8ac-42a8-b0b2-5c640db7ee5c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:40.649945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe78766e-e8ac-42a8-b0b2-5c640db7ee5c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:40.650732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe78766e-e8ac-42a8-b0b2-5c640db7ee5c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:40.713950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fe78766e-e8ac-42a8-b0b2-5c640db7ee5c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:40.721555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fe78766e-e8ac-42a8-b0b2-5c640db7ee5c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085859 Feb 21 01:04:40.722126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 766/1347] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:40 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:41.360909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:41.362044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:41.370022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:41.370459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:41.371236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:41.371659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:41.431846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:41.440623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:41.442103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:41.443253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-688dc3c9-6c2f-485f-8f81-18490d206ad2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088753 Feb 21 01:04:41.443809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 582/1348] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:41 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:41.742306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-78eab5f7-b0c1-4264-865c-42b5b652e4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:41.743323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-78eab5f7-b0c1-4264-865c-42b5b652e4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:41.754220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78eab5f7-b0c1-4264-865c-42b5b652e4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:41.754977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78eab5f7-b0c1-4264-865c-42b5b652e4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:41.756353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78eab5f7-b0c1-4264-865c-42b5b652e4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:41.756818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78eab5f7-b0c1-4264-865c-42b5b652e4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:41.828563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-78eab5f7-b0c1-4264-865c-42b5b652e4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:41.836152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-78eab5f7-b0c1-4264-865c-42b5b652e4e0 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100063 Feb 21 01:04:41.836748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 767/1349] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:41 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:42.470051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:42.470748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:42.478951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:42.479395 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:42.480159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:42.480635 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:42.541506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:42.550298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:42.551786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:42.552984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-85095235-4391-43d4-aa74-1de5e8772266 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089203 Feb 21 01:04:42.553537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 583/1350] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:42.857271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a537c5d6-70cd-4860-969f-0701e3fe00fd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:42.858219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a537c5d6-70cd-4860-969f-0701e3fe00fd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:42.867824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a537c5d6-70cd-4860-969f-0701e3fe00fd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:42.868258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a537c5d6-70cd-4860-969f-0701e3fe00fd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:42.869091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a537c5d6-70cd-4860-969f-0701e3fe00fd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:42.869547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a537c5d6-70cd-4860-969f-0701e3fe00fd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:42.938583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a537c5d6-70cd-4860-969f-0701e3fe00fd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:42.946452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a537c5d6-70cd-4860-969f-0701e3fe00fd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.095640 Feb 21 01:04:42.947025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 768/1351] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:42 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:43.570103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:43.570705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:43.577477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:43.577934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:43.578711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:43.579131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:43.641771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:43.650763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:43.652234 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:43.653393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4f675e47-0916-49b4-874f-da2e7c363a24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087093 Feb 21 01:04:43.653914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 584/1352] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:43.967235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce38d74e-100d-4c7e-9703-cd697ced98dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:43.968106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce38d74e-100d-4c7e-9703-cd697ced98dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:43.977421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce38d74e-100d-4c7e-9703-cd697ced98dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:43.977863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce38d74e-100d-4c7e-9703-cd697ced98dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:43.978627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce38d74e-100d-4c7e-9703-cd697ced98dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:43.979051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce38d74e-100d-4c7e-9703-cd697ced98dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:44.041890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce38d74e-100d-4c7e-9703-cd697ced98dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:44.049634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce38d74e-100d-4c7e-9703-cd697ced98dd tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.088634 Feb 21 01:04:44.050204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 769/1353] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:43 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:44.675648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:44.677162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:44.687802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:44.688584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:44.689854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:44.690571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:44.758001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:44.770523 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:44.773036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:44.774817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-04750f02-0a56-4727-9495-b916acb6200e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.105696 Feb 21 01:04:44.775969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 585/1354] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:44 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:45.070541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-11a8ab5b-a190-4fb0-aff9-576af1ee4877 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:45.071582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-11a8ab5b-a190-4fb0-aff9-576af1ee4877 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:45.082359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11a8ab5b-a190-4fb0-aff9-576af1ee4877 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:45.083137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11a8ab5b-a190-4fb0-aff9-576af1ee4877 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:45.084450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11a8ab5b-a190-4fb0-aff9-576af1ee4877 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:45.084900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11a8ab5b-a190-4fb0-aff9-576af1ee4877 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:45.148891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-11a8ab5b-a190-4fb0-aff9-576af1ee4877 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:45.157090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-11a8ab5b-a190-4fb0-aff9-576af1ee4877 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092718 Feb 21 01:04:45.157659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 770/1355] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:45 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:45.797142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:45.798180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:45.806750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:45.807649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:45.807926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:45.808356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:45.877611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:45.889592 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:45.891836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:45.893564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5176ee6a-9b4d-4c86-84fe-403047a030e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102654 Feb 21 01:04:45.894280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 586/1356] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:45 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:46.178645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-796515d7-1320-410b-8756-53f5af4047d1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:46.179485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-796515d7-1320-410b-8756-53f5af4047d1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:46.190327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-796515d7-1320-410b-8756-53f5af4047d1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:46.191072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-796515d7-1320-410b-8756-53f5af4047d1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:46.192354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-796515d7-1320-410b-8756-53f5af4047d1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:46.193118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-796515d7-1320-410b-8756-53f5af4047d1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:46.254775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-796515d7-1320-410b-8756-53f5af4047d1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:46.262415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-796515d7-1320-410b-8756-53f5af4047d1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090640 Feb 21 01:04:46.262995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 771/1357] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:46 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:46.916966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:46.917859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:46.928516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:46.929268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:46.930610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:46.931340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:46.998934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:47.008192 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:47.009859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:47.011106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a5cb20c5-2e2f-4878-a63d-601838415b7e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100691 Feb 21 01:04:47.011677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 587/1358] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:47.285943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b9874c28-7ee8-4f91-9f25-68b188afcc7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:47.286742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b9874c28-7ee8-4f91-9f25-68b188afcc7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:47.294981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9874c28-7ee8-4f91-9f25-68b188afcc7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:47.295533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9874c28-7ee8-4f91-9f25-68b188afcc7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:47.296573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9874c28-7ee8-4f91-9f25-68b188afcc7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:47.297109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9874c28-7ee8-4f91-9f25-68b188afcc7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:47.357646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b9874c28-7ee8-4f91-9f25-68b188afcc7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:47.365603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b9874c28-7ee8-4f91-9f25-68b188afcc7f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084213 Feb 21 01:04:47.366171 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 772/1359] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:47 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:48.033506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:48.034496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:48.045122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:48.045851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:48.047134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:48.047824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:48.109459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:48.117922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:48.119403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:48.120560 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1354c321-9a78-4972-8b61-060a7aaedfa1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093478 Feb 21 01:04:48.121115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 588/1360] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:48.391420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6a46a34e-4ac4-4549-a642-28590ae98e3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:48.392289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6a46a34e-4ac4-4549-a642-28590ae98e3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:48.403682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a46a34e-4ac4-4549-a642-28590ae98e3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:48.404454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a46a34e-4ac4-4549-a642-28590ae98e3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:48.405771 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a46a34e-4ac4-4549-a642-28590ae98e3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:48.406461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a46a34e-4ac4-4549-a642-28590ae98e3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:48.469790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6a46a34e-4ac4-4549-a642-28590ae98e3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:48.478380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6a46a34e-4ac4-4549-a642-28590ae98e3a tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093281 Feb 21 01:04:48.478951 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 773/1361] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:48 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:49.144304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:49.145784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:49.159967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:49.160779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:49.162044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:49.162754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:49.225977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:49.234387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:49.235869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:49.237032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-83388e9b-577e-439b-95e2-2049bfbbfdbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100495 Feb 21 01:04:49.237587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 589/1362] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:49.499513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6a997d4d-fabf-42f2-82bb-1c8e64047060 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:49.500528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6a997d4d-fabf-42f2-82bb-1c8e64047060 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:49.511330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a997d4d-fabf-42f2-82bb-1c8e64047060 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:49.512059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a997d4d-fabf-42f2-82bb-1c8e64047060 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:49.513377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a997d4d-fabf-42f2-82bb-1c8e64047060 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:49.514076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6a997d4d-fabf-42f2-82bb-1c8e64047060 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:49.577970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6a997d4d-fabf-42f2-82bb-1c8e64047060 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:49.585866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6a997d4d-fabf-42f2-82bb-1c8e64047060 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.092639 Feb 21 01:04:49.586440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 774/1363] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:49 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:50.258673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:50.259596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:50.270231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:50.271012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:50.272288 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:50.273057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:50.335138 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:50.344751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:50.346249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:50.347405 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-96b72cf0-b8fb-4a67-b749-b80db4f354aa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094968 Feb 21 01:04:50.347964 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 590/1364] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:50 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:50.607149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-213995ec-4e2f-4799-a5ce-f5b39e1dc1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:50.608141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-213995ec-4e2f-4799-a5ce-f5b39e1dc1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:50.618058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-213995ec-4e2f-4799-a5ce-f5b39e1dc1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:50.618792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-213995ec-4e2f-4799-a5ce-f5b39e1dc1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:50.620044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-213995ec-4e2f-4799-a5ce-f5b39e1dc1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:50.620803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-213995ec-4e2f-4799-a5ce-f5b39e1dc1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:50.686668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-213995ec-4e2f-4799-a5ce-f5b39e1dc1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:50.694556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-213995ec-4e2f-4799-a5ce-f5b39e1dc1c1 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.093763 Feb 21 01:04:50.695145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 775/1365] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:50 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:51.369190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:51.370139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:51.380821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:51.381602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:51.382925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:51.383369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:51.452345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:51.463495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:51.466759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:51.469246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-49ac2f46-48af-4349-a44a-86421614bfd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.105480 Feb 21 01:04:51.470182 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 591/1366] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:51 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:51.715726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-80847099-8c78-4ad5-8edf-c296ec802ab9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:51.716640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-80847099-8c78-4ad5-8edf-c296ec802ab9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:51.727602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80847099-8c78-4ad5-8edf-c296ec802ab9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:51.728344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80847099-8c78-4ad5-8edf-c296ec802ab9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:51.729664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80847099-8c78-4ad5-8edf-c296ec802ab9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:51.730385 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80847099-8c78-4ad5-8edf-c296ec802ab9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:51.798582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-80847099-8c78-4ad5-8edf-c296ec802ab9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:51.806730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-80847099-8c78-4ad5-8edf-c296ec802ab9 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097687 Feb 21 01:04:51.807298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 776/1367] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:51 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:52.492979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:52.493862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:52.502303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:52.502869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:52.503855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:52.504368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:52.576683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:52.585850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:52.587462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:52.588648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-032b0c3b-b3a6-4c4a-9024-dfc20ec64390 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102237 Feb 21 01:04:52.589205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 592/1368] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:52.827165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8983235a-e387-4182-8206-57e3b60792e2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:52.828021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8983235a-e387-4182-8206-57e3b60792e2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:52.838661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8983235a-e387-4182-8206-57e3b60792e2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:52.839389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8983235a-e387-4182-8206-57e3b60792e2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:52.840740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8983235a-e387-4182-8206-57e3b60792e2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:52.841461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8983235a-e387-4182-8206-57e3b60792e2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:52.911765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8983235a-e387-4182-8206-57e3b60792e2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:52.920547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8983235a-e387-4182-8206-57e3b60792e2 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.099862 Feb 21 01:04:52.921083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 777/1369] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:52 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:53.607799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:53.609090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:53.616006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:53.616519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:53.617309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:53.617744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:53.678597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:53.687468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:53.688987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:53.690162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b047dbf3-aab2-4f74-a706-ba80e213fb24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086096 Feb 21 01:04:53.690719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 593/1370] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:53 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:53.941635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fb80529d-857c-4a51-9a51-c6534d72443e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:53.942485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fb80529d-857c-4a51-9a51-c6534d72443e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:53.953230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb80529d-857c-4a51-9a51-c6534d72443e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:53.953974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb80529d-857c-4a51-9a51-c6534d72443e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:53.955257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb80529d-857c-4a51-9a51-c6534d72443e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:53.955976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb80529d-857c-4a51-9a51-c6534d72443e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:54.019032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb80529d-857c-4a51-9a51-c6534d72443e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:54.027116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fb80529d-857c-4a51-9a51-c6534d72443e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091955 Feb 21 01:04:54.027697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 778/1371] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:53 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:54.711442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:54.712249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:54.719057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:54.719438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:54.720215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:54.720676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:54.791989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:54.800942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:54.802418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:54.803579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-31a34425-54b0-4892-b16b-a20cb3abe047 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098152 Feb 21 01:04:54.804125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 594/1372] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:54 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:55.048281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ac18bc55-7515-47ca-b512-0ea9834e6fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:55.049383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ac18bc55-7515-47ca-b512-0ea9834e6fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:55.059992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ac18bc55-7515-47ca-b512-0ea9834e6fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:55.060800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ac18bc55-7515-47ca-b512-0ea9834e6fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:55.062082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ac18bc55-7515-47ca-b512-0ea9834e6fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:55.062792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ac18bc55-7515-47ca-b512-0ea9834e6fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:55.126528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ac18bc55-7515-47ca-b512-0ea9834e6fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:55.134063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ac18bc55-7515-47ca-b512-0ea9834e6fcc tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091957 Feb 21 01:04:55.134630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 779/1373] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:55 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:55.312515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:04:55.312834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:04:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:04:55.825426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:55.826450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:55.837287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:55.837995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:55.839303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:55.840017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:55.918790 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:55.927668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:55.929201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:55.930333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-55fec8d5-8f34-4575-94ff-2aa5b5b5e115 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.111373 Feb 21 01:04:55.930892 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 595/1374] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:56.150963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ccf5c632-bb69-453d-b070-2f7acef9faa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:56.151573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ccf5c632-bb69-453d-b070-2f7acef9faa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:56.158290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccf5c632-bb69-453d-b070-2f7acef9faa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:56.158969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccf5c632-bb69-453d-b070-2f7acef9faa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:56.159539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccf5c632-bb69-453d-b070-2f7acef9faa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:56.159964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccf5c632-bb69-453d-b070-2f7acef9faa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:56.218577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ccf5c632-bb69-453d-b070-2f7acef9faa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:56.226140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ccf5c632-bb69-453d-b070-2f7acef9faa8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.079330 Feb 21 01:04:56.226709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 780/1375] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:56 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:56.952470 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:56.953336 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:56.963873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:56.964315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:56.965119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:56.965550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:57.035569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:57.044229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:57.045766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:57.046926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1a97fbd9-49f7-4c4f-88bf-827823234091 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100883 Feb 21 01:04:57.047507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 596/1376] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:56 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:57.246682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6accd3f5-bafc-42a4-9be6-1546f72eae03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:57.247528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6accd3f5-bafc-42a4-9be6-1546f72eae03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:57.256144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6accd3f5-bafc-42a4-9be6-1546f72eae03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:57.256791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6accd3f5-bafc-42a4-9be6-1546f72eae03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:57.257812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6accd3f5-bafc-42a4-9be6-1546f72eae03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:57.258384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6accd3f5-bafc-42a4-9be6-1546f72eae03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:57.319200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6accd3f5-bafc-42a4-9be6-1546f72eae03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:57.327145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6accd3f5-bafc-42a4-9be6-1546f72eae03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086322 Feb 21 01:04:57.327713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 781/1377] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:57 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:58.068584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:58.069555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:58.077362 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:58.077800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:58.078566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:58.078988 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:58.149512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:58.158644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:58.160120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:58.161301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ceb23ea8-e1e4-433c-a2b8-e0bfeb0350c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.099021 Feb 21 01:04:58.161849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 597/1378] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:58.347166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-378e71e7-5a5a-4ff4-ab3c-c4c4a7bb9a06 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:58.348013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-378e71e7-5a5a-4ff4-ab3c-c4c4a7bb9a06 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:58.356576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378e71e7-5a5a-4ff4-ab3c-c4c4a7bb9a06 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:58.357012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378e71e7-5a5a-4ff4-ab3c-c4c4a7bb9a06 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:58.357782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378e71e7-5a5a-4ff4-ab3c-c4c4a7bb9a06 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:58.358201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-378e71e7-5a5a-4ff4-ab3c-c4c4a7bb9a06 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:58.426734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-378e71e7-5a5a-4ff4-ab3c-c4c4a7bb9a06 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:58.435099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-378e71e7-5a5a-4ff4-ab3c-c4c4a7bb9a06 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094133 Feb 21 01:04:58.435680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 782/1379] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:58 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:04:59.183412 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:59.184093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:59.190984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:59.191454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:59.192264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:59.192755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:59.261203 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:59.269871 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:59.271365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:59.272575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c5eb540f-07d3-4df4-8447-8a384a4ab32e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095881 Feb 21 01:04:59.273127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 598/1380] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:04:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:04:59.453182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9297add2-c7fa-4afe-9a8f-a20371f951d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:04:59.454320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9297add2-c7fa-4afe-9a8f-a20371f951d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:04:59.461493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9297add2-c7fa-4afe-9a8f-a20371f951d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:59.462043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9297add2-c7fa-4afe-9a8f-a20371f951d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:59.462999 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9297add2-c7fa-4afe-9a8f-a20371f951d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:04:59.463525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9297add2-c7fa-4afe-9a8f-a20371f951d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:04:59.525450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9297add2-c7fa-4afe-9a8f-a20371f951d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:04:59.532929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9297add2-c7fa-4afe-9a8f-a20371f951d8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.085123 Feb 21 01:04:59.533679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 783/1381] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:04:59 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:00.294139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:00.295033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:00.301610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:00.302053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:00.302825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:00.303250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:00.365403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:00.379751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:00.382530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:00.384239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d1f2e793-a51d-4100-84a3-20f96c3abee8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095526 Feb 21 01:05:00.385213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 599/1382] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:00 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:00.550238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c96237b0-5506-4050-9745-873d595bf51f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:00.550787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c96237b0-5506-4050-9745-873d595bf51f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:00.557646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c96237b0-5506-4050-9745-873d595bf51f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:00.558087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c96237b0-5506-4050-9745-873d595bf51f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:00.558862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c96237b0-5506-4050-9745-873d595bf51f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:00.559288 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c96237b0-5506-4050-9745-873d595bf51f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:00.628638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c96237b0-5506-4050-9745-873d595bf51f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:00.636826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c96237b0-5506-4050-9745-873d595bf51f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090415 Feb 21 01:05:00.637432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 784/1383] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:00 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:01.405201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:01.405800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:01.412501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:01.412947 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:01.413751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:01.414183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:01.473316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:01.481909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:01.483384 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:01.484537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dc8cf006-f765-4f7c-beaa-58034354f779 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083738 Feb 21 01:05:01.485085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 600/1384] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:01.657953 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-89d44c93-1ed0-4842-84e2-b7c1ecb716c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:01.658795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-89d44c93-1ed0-4842-84e2-b7c1ecb716c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:01.669366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89d44c93-1ed0-4842-84e2-b7c1ecb716c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:01.670106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89d44c93-1ed0-4842-84e2-b7c1ecb716c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:01.671374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89d44c93-1ed0-4842-84e2-b7c1ecb716c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:01.672253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89d44c93-1ed0-4842-84e2-b7c1ecb716c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:01.738489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-89d44c93-1ed0-4842-84e2-b7c1ecb716c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:01.749729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-89d44c93-1ed0-4842-84e2-b7c1ecb716c8 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.097870 Feb 21 01:05:01.750530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 785/1385] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:01 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:02.506367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:02.507333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:02.515549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:02.515995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:02.516810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:02.517240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:02.586170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:02.594770 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:02.596426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:02.597551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4843ba03-a7a1-4059-9b3c-af33fa8a2810 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097483 Feb 21 01:05:02.598105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 601/1386] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:02.774494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8df8ecb4-76db-4411-9d1f-140ba789e423 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:02.775755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8df8ecb4-76db-4411-9d1f-140ba789e423 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:02.786441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8df8ecb4-76db-4411-9d1f-140ba789e423 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:02.787180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8df8ecb4-76db-4411-9d1f-140ba789e423 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:02.788468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8df8ecb4-76db-4411-9d1f-140ba789e423 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:02.789239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8df8ecb4-76db-4411-9d1f-140ba789e423 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:02.853782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8df8ecb4-76db-4411-9d1f-140ba789e423 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:02.865000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8df8ecb4-76db-4411-9d1f-140ba789e423 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.096537 Feb 21 01:05:02.865724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 786/1387] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:02 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:03.619422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:03.621182 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:03.628416 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:03.628875 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:03.629672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:03.630100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:03.690322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:03.698674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:03.700177 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:03.701329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-15ab4357-8fe3-417d-9f1e-3ce47c03c2e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088135 Feb 21 01:05:03.701881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 602/1388] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:03.886813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-caf2b32a-2147-4621-9882-13185270fe03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:03.887683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-caf2b32a-2147-4621-9882-13185270fe03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:03.898200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf2b32a-2147-4621-9882-13185270fe03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:03.898937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf2b32a-2147-4621-9882-13185270fe03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:03.900806 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf2b32a-2147-4621-9882-13185270fe03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:03.901618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-caf2b32a-2147-4621-9882-13185270fe03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:03.960587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-caf2b32a-2147-4621-9882-13185270fe03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:03.968181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-caf2b32a-2147-4621-9882-13185270fe03 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.087627 Feb 21 01:05:03.968776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 787/1389] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:03 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:04.723128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:04.724067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:04.732932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:04.733371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:04.734136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:04.734561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:04.804432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:04.813129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:04.814600 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:04.815725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9c139e48-b454-4de2-9f97-a249e29701c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098925 Feb 21 01:05:04.816275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 603/1390] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:04.985906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9b2459e1-b4f2-4709-b10f-5ee8679301ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:04.986528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9b2459e1-b4f2-4709-b10f-5ee8679301ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:04.993766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9b2459e1-b4f2-4709-b10f-5ee8679301ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:04.994225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9b2459e1-b4f2-4709-b10f-5ee8679301ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:04.995023 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9b2459e1-b4f2-4709-b10f-5ee8679301ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:04.995468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9b2459e1-b4f2-4709-b10f-5ee8679301ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:05.065011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9b2459e1-b4f2-4709-b10f-5ee8679301ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:05.072824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9b2459e1-b4f2-4709-b10f-5ee8679301ea tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.090793 Feb 21 01:05:05.073394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 788/1391] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:04 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:05.837352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:05.838301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:05.845467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:05.845912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:05.846692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:05.847118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:05.908111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:05.916584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:05.918068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:05.919237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-46c4afc3-eef3-47f7-aa0c-f32a4a71d6f8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088110 Feb 21 01:05:05.919802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 604/1392] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:06.092272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1759224e-daf3-4cf3-b49a-537f4a106d8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:06.092982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1759224e-daf3-4cf3-b49a-537f4a106d8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:06.101099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1759224e-daf3-4cf3-b49a-537f4a106d8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:06.101647 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1759224e-daf3-4cf3-b49a-537f4a106d8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:06.102608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1759224e-daf3-4cf3-b49a-537f4a106d8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:06.103145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1759224e-daf3-4cf3-b49a-537f4a106d8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:06.173322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1759224e-daf3-4cf3-b49a-537f4a106d8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:06.181491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1759224e-daf3-4cf3-b49a-537f4a106d8e tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094769 Feb 21 01:05:06.182053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 789/1393] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:06 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:06.937541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:06.938125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:06.944850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:06.945298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:06.946062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:06.946489 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:07.008684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:07.017785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:07.019257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:07.020377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a56f79c1-6599-432d-80ea-33d7193d37c8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086598 Feb 21 01:05:07.020955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 605/1394] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:06 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:07.201961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-acaa857d-8441-40df-ad94-3a99ccf9eb2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:07.202969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-acaa857d-8441-40df-ad94-3a99ccf9eb2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:07.213738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acaa857d-8441-40df-ad94-3a99ccf9eb2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:07.214523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acaa857d-8441-40df-ad94-3a99ccf9eb2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:07.215846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acaa857d-8441-40df-ad94-3a99ccf9eb2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:07.216695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-acaa857d-8441-40df-ad94-3a99ccf9eb2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:07.287338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-acaa857d-8441-40df-ad94-3a99ccf9eb2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:07.295602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-acaa857d-8441-40df-ad94-3a99ccf9eb2b tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.100041 Feb 21 01:05:07.296192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 790/1395] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:07 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:08.042754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:08.043407 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:08.050842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:08.051346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:08.052207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:08.052732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:08.116579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:08.125310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:08.126802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:08.127967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1d2c0892-89da-46a5-9312-dff0453889c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091563 Feb 21 01:05:08.128564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 606/1396] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:08.314160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-19e5b751-2391-430f-b639-f669b47a7c59 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:08.314813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-19e5b751-2391-430f-b639-f669b47a7c59 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:08.323038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-19e5b751-2391-430f-b639-f669b47a7c59 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:08.323672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-19e5b751-2391-430f-b639-f669b47a7c59 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:08.324743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-19e5b751-2391-430f-b639-f669b47a7c59 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:08.325312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-19e5b751-2391-430f-b639-f669b47a7c59 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:08.387972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-19e5b751-2391-430f-b639-f669b47a7c59 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:08.395634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-19e5b751-2391-430f-b639-f669b47a7c59 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.086496 Feb 21 01:05:08.396206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 791/1397] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:08 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:09.146420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:09.147072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:09.154800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:09.155239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:09.156068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:09.156535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:09.223143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:09.232585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:09.234069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:09.235217 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-75dd93b2-0bde-4413-8b44-c0e767026636 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092707 Feb 21 01:05:09.236059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 607/1398] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:09.416540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e536e498-d0f5-4ffe-a9ac-4879ae07ce18 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:09.417510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e536e498-d0f5-4ffe-a9ac-4879ae07ce18 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:09.424218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e536e498-d0f5-4ffe-a9ac-4879ae07ce18 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:09.424689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e536e498-d0f5-4ffe-a9ac-4879ae07ce18 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:09.425498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e536e498-d0f5-4ffe-a9ac-4879ae07ce18 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:09.425925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e536e498-d0f5-4ffe-a9ac-4879ae07ce18 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:09.493994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e536e498-d0f5-4ffe-a9ac-4879ae07ce18 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:09.501509 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e536e498-d0f5-4ffe-a9ac-4879ae07ce18 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091298 Feb 21 01:05:09.502071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 792/1399] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:09 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:10.257116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:10.258098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:10.265942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:10.266398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:10.267162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:10.267592 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:10.326511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:10.334897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:10.336370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:10.337544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a8e0c8e3-7238-4580-b33a-0c5507a685d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086739 Feb 21 01:05:10.338091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 608/1400] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:10 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:10.522514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-52953814-5403-406a-89b0-72de11043153 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:10.523474 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-52953814-5403-406a-89b0-72de11043153 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:10.531756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52953814-5403-406a-89b0-72de11043153 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:10.532200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52953814-5403-406a-89b0-72de11043153 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:10.533028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52953814-5403-406a-89b0-72de11043153 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:10.533461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52953814-5403-406a-89b0-72de11043153 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:10.592757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-52953814-5403-406a-89b0-72de11043153 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:10.600720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-52953814-5403-406a-89b0-72de11043153 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.084571 Feb 21 01:05:10.601281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 793/1401] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:10 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:11.355870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:11.356494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:11.363073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:11.363752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:11.364633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:11.365069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:11.434815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:11.443022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:11.444504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:11.445658 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-239f96ad-ba73-4402-9475-9eee09bb1d76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093646 Feb 21 01:05:11.446214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 609/1402] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:11.547514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:05:11.547962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:05:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:05:11.621084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-58357a82-1317-4613-852c-553c79d839f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:11.622070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-58357a82-1317-4613-852c-553c79d839f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:11.632712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-58357a82-1317-4613-852c-553c79d839f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:11.633454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-58357a82-1317-4613-852c-553c79d839f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:11.634721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-58357a82-1317-4613-852c-553c79d839f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:11.635410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-58357a82-1317-4613-852c-553c79d839f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:11.711882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-58357a82-1317-4613-852c-553c79d839f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:11.719942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-58357a82-1317-4613-852c-553c79d839f5 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.104866 Feb 21 01:05:11.720526 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 794/1403] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:11 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:12.467329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:12.468168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:12.476191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:12.476748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:12.477659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:12.478167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:12.542279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:12.550832 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:12.552348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:12.553525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1d0cac54-ae35-4c35-9e64-884e160c536e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092119 Feb 21 01:05:12.554089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 610/1404] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:12.606264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:05:12.607102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:05:12.746813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b3e3d49b-6477-46fb-b2f5-36c16357729f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:12.747857 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b3e3d49b-6477-46fb-b2f5-36c16357729f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:12.759401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3e3d49b-6477-46fb-b2f5-36c16357729f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:12.760143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3e3d49b-6477-46fb-b2f5-36c16357729f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:12.761502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3e3d49b-6477-46fb-b2f5-36c16357729f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:12.762213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3e3d49b-6477-46fb-b2f5-36c16357729f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:12.839075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b3e3d49b-6477-46fb-b2f5-36c16357729f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:12.850391 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b3e3d49b-6477-46fb-b2f5-36c16357729f tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.114237 Feb 21 01:05:12.851142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 795/1405] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:12 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:13.571328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:13.571937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:13.578992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:13.579439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:13.580202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:13.580675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:13.648033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:13.657392 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:13.658785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:13.659927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3ebc9541-b480-44c7-935f-97fd915068bb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092489 Feb 21 01:05:13.660515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 611/1406] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:13.867402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-db183018-ec23-49a7-ac85-4922456faa85 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:13.868012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-db183018-ec23-49a7-ac85-4922456faa85 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:13.874739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-db183018-ec23-49a7-ac85-4922456faa85 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:13.875187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-db183018-ec23-49a7-ac85-4922456faa85 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:13.875969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-db183018-ec23-49a7-ac85-4922456faa85 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:13.876409 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-db183018-ec23-49a7-ac85-4922456faa85 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:13.939302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-db183018-ec23-49a7-ac85-4922456faa85 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:13.946711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-db183018-ec23-49a7-ac85-4922456faa85 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.083064 Feb 21 01:05:13.947557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 796/1407] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:13 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:14.682655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:14.683700 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:14.690768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:14.691206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:14.691973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:14.692422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:14.754452 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:14.762936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:14.765671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:14.767020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-00644a60-5099-45da-a740-1d1dae4644a4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091433 Feb 21 01:05:14.768712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 612/1408] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:14.968161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4deef121-baa6-49f6-bd94-378005a14728 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:14.969092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4deef121-baa6-49f6-bd94-378005a14728 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:14.979664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4deef121-baa6-49f6-bd94-378005a14728 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:14.980433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4deef121-baa6-49f6-bd94-378005a14728 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:14.981710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4deef121-baa6-49f6-bd94-378005a14728 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:14.982414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4deef121-baa6-49f6-bd94-378005a14728 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:15.045260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4deef121-baa6-49f6-bd94-378005a14728 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:15.053534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4deef121-baa6-49f6-bd94-378005a14728 tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.091990 Feb 21 01:05:15.054225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 797/1409] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:14 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:15.789533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:15.790636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:15.799422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:15.799867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:15.800672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:15.801104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:15.870833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:15.883215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:15.885503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:15.887150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ead48d1-0fea-492f-a95b-440863106e8c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103634 Feb 21 01:05:15.887878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 613/1410] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:16.074869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-87e3b40a-e82c-42d7-ae86-4cb3a9bd8d7c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:16.075805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-87e3b40a-e82c-42d7-ae86-4cb3a9bd8d7c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] [instance: 9d201f02-8582-4720-942e-8d62400e176f] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:16.086880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-87e3b40a-e82c-42d7-ae86-4cb3a9bd8d7c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:16.087611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-87e3b40a-e82c-42d7-ae86-4cb3a9bd8d7c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:16.088939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-87e3b40a-e82c-42d7-ae86-4cb3a9bd8d7c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:16.089655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-87e3b40a-e82c-42d7-ae86-4cb3a9bd8d7c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:16.154563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-87e3b40a-e82c-42d7-ae86-4cb3a9bd8d7c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c50243a8d4b447bb5d6b5a811cb28fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeb7d92f478431e94fea34d24389a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:16.162839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-87e3b40a-e82c-42d7-ae86-4cb3a9bd8d7c tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f" status: 200 len: 1220 microversion: 2.1 time: 0.094435 Feb 21 01:05:16.163392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 798/1411] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:16 2022] GET /compute/v2.1/servers/9d201f02-8582-4720-942e-8d62400e176f => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:16.344414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a8761f6b-04b0-45fa-b39f-175a8d2c5cad tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] Calling method '.version_select at 0x7fe56d69a9d0>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:16.372130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a8761f6b-04b0-45fa-b39f-175a8d2c5cad tempest-TestShelveInstance-1673668922 tempest-TestShelveInstance-1673668922-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1668814767" status: 202 len: 0 microversion: 2.1 time: 0.031436 Feb 21 01:05:16.373312 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 614/1412] 10.222.0.72 () {58 vars in 1253 bytes} [Mon Feb 21 01:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1668814767 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:05:16.906991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:16.907502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:16.915380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:16.915875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:16.916698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:16.917131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:16.981196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:16.989553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:16.991029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:16.992218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-26ed202d-5576-4977-8924-fbca2926811b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089494 Feb 21 01:05:16.993049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 799/1413] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:18.010742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:18.011375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:18.017351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:18.017799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:18.018580 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:18.019006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:18.082136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:18.090898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:18.092408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:18.093588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a8b4e348-b08d-4633-a360-15a5031a24b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087162 Feb 21 01:05:18.094090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 615/1414] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:19.111480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:19.112031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:19.118833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:19.119365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:19.120249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:19.120715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:19.184972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:19.193943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:19.195431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:19.196617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a5c013bd-dc89-4f8a-8c50-ee2a49be2e82 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089070 Feb 21 01:05:19.197162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 800/1415] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:20.214899 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:20.215458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:20.221826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:20.222238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:20.223157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:20.223582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:20.283551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:20.291698 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:20.293214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:20.294352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-38a12ec6-507b-4e97-8a7d-eb4fa91e545f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083400 Feb 21 01:05:20.294908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 616/1416] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:21.312961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:21.313602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:21.322709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:21.323148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:21.323936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:21.324366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:21.505556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:21.514259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:21.515727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:21.516899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4660a6e0-460b-4216-b483-6d024b7d8808 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.207665 Feb 21 01:05:21.517478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 801/1417] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:22.535720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:22.536239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:22.543393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:22.543887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:22.544782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:22.545294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:22.629046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:22.637729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:22.639458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:22.640652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-934aa9b4-2546-4919-9413-b85572d615f5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.108830 Feb 21 01:05:22.641213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 617/1418] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:23.658895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:23.659617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:23.665880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:23.666313 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:23.667076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:23.667496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:23.728128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:23.736891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:23.738394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:23.739523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4f6ea90f-ecb2-4ba2-9f76-1ae7ee4081cd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.084506 Feb 21 01:05:23.740073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 802/1419] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:24.761231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:24.762224 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:24.770776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:24.771218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:24.771982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:24.772434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:24.836312 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:24.845404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:24.846877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:24.848038 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4b8a23ec-1a5c-4b4d-ba15-4881d5c626fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093017 Feb 21 01:05:24.848593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 618/1420] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:25.869447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:25.870019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:25.878840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:25.879278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:25.880044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:25.880497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:25.949658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:25.958591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:25.960069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:25.961213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-df65ee9a-11d6-4a15-a71a-6124acbc9fb0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097949 Feb 21 01:05:25.961773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 803/1421] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:26.983295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:26.984263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:26.991795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:26.992255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:26.993118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:26.993561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:27.060172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:27.068858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:27.070352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:27.071489 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fa3ebf55-eb97-4c2c-9d2a-83cf2738de14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094548 Feb 21 01:05:27.072047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 619/1422] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:28.093509 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:28.094462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:28.101609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:28.102077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:28.102923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:28.103372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:28.165629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:28.174154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:28.175631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:28.176786 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3e7dfb31-7b8d-4b93-a277-a55b3ce9852f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089731 Feb 21 01:05:28.177347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 804/1423] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:28.879346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a75f32ed-d606-48f8-84fc-18349e02a6cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:28.880613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a75f32ed-d606-48f8-84fc-18349e02a6cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:28.887225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a75f32ed-d606-48f8-84fc-18349e02a6cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:28.887727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a75f32ed-d606-48f8-84fc-18349e02a6cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:28.888586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a75f32ed-d606-48f8-84fc-18349e02a6cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:28.889256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a75f32ed-d606-48f8-84fc-18349e02a6cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:28.918057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5ffdb43b-65b7-4821-b991-00b6f8358eb5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:28.919262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5ffdb43b-65b7-4821-b991-00b6f8358eb5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:28.924588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a75f32ed-d606-48f8-84fc-18349e02a6cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:05:28.927862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ffdb43b-65b7-4821-b991-00b6f8358eb5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:28.927862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ffdb43b-65b7-4821-b991-00b6f8358eb5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:28.928723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ffdb43b-65b7-4821-b991-00b6f8358eb5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:28.928936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ffdb43b-65b7-4821-b991-00b6f8358eb5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:28.954443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5ffdb43b-65b7-4821-b991-00b6f8358eb5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Going to try to terminate instance {{(pid=123098) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:05:29.040102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a75f32ed-d606-48f8-84fc-18349e02a6cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 204 len: 0 microversion: 2.1 time: 0.163577 Feb 21 01:05:29.044851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 620/1424] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:05:28 2022] DELETE /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:05:29.047621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fb6023e2-0d44-4976-855b-28523bbf8ba5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] Calling method '.version_select at 0x7fe56d7280d0>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:29.067615 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fb6023e2-0d44-4976-855b-28523bbf8ba5 tempest-TestVolumeBootPattern-507151351 tempest-TestVolumeBootPattern-507151351-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1495553514" status: 202 len: 0 microversion: 2.1 time: 0.024504 Feb 21 01:05:29.068458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 621/1425] 10.222.0.72 () {58 vars in 1262 bytes} [Mon Feb 21 01:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1495553514 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:05:29.074175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5ffdb43b-65b7-4821-b991-00b6f8358eb5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 204 len: 0 microversion: 2.1 time: 0.154076 Feb 21 01:05:29.074349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e17dce6a-a6bd-4b17-8b5f-876b358df788 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:29.074461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 805/1426] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:05:28 2022] DELETE /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:05:29.074559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e17dce6a-a6bd-4b17-8b5f-876b358df788 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:29.081761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e17dce6a-a6bd-4b17-8b5f-876b358df788 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:29.082524 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e17dce6a-a6bd-4b17-8b5f-876b358df788 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:29.083380 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e17dce6a-a6bd-4b17-8b5f-876b358df788 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:29.083743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e17dce6a-a6bd-4b17-8b5f-876b358df788 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:29.094582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a3829c48-ce6b-4221-8267-75dabb127b20 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:29.097167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a3829c48-ce6b-4221-8267-75dabb127b20 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:29.107789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3829c48-ce6b-4221-8267-75dabb127b20 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:29.108373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3829c48-ce6b-4221-8267-75dabb127b20 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:29.109201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3829c48-ce6b-4221-8267-75dabb127b20 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:29.109641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a3829c48-ce6b-4221-8267-75dabb127b20 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:29.234629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e17dce6a-a6bd-4b17-8b5f-876b358df788 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:29.242996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e17dce6a-a6bd-4b17-8b5f-876b358df788 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173370 Feb 21 01:05:29.243953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 622/1427] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:29 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:29.256497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:29.257045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:29.261062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a3829c48-ce6b-4221-8267-75dabb127b20 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:29.263053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:29.263508 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:29.264510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:29.264759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:29.269642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a3829c48-ce6b-4221-8267-75dabb127b20 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.180513 Feb 21 01:05:29.270446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 806/1428] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:29 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:29.324758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:29.333192 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:29.334831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:29.336057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1cfe0dec-dd81-4a2a-97cc-1fbe1a963e6a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090797 Feb 21 01:05:29.336737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 623/1429] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:30.262080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f389c677-10c8-49af-b275-0a64b3355a02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:30.262690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f389c677-10c8-49af-b275-0a64b3355a02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:30.269799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f389c677-10c8-49af-b275-0a64b3355a02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:30.270235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f389c677-10c8-49af-b275-0a64b3355a02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:30.271014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f389c677-10c8-49af-b275-0a64b3355a02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:30.271438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f389c677-10c8-49af-b275-0a64b3355a02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:30.287348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d046bc2e-5525-480e-bcc4-a69745d8558b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:30.287978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d046bc2e-5525-480e-bcc4-a69745d8558b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:30.295824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d046bc2e-5525-480e-bcc4-a69745d8558b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:30.296245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d046bc2e-5525-480e-bcc4-a69745d8558b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:30.297082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d046bc2e-5525-480e-bcc4-a69745d8558b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:30.297511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d046bc2e-5525-480e-bcc4-a69745d8558b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:30.450403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d046bc2e-5525-480e-bcc4-a69745d8558b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:30.458614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d046bc2e-5525-480e-bcc4-a69745d8558b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.175104 Feb 21 01:05:30.463378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 624/1430] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:30 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:05:30.463707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:30.464722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:30.470649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:30.471088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:30.471859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:30.472333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:30.532246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:30.541003 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:30.542486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:30.543617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-68c546d4-3b41-4817-adc4-cd3571b082b2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083316 Feb 21 01:05:30.544167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 625/1431] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:30.547682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f389c677-10c8-49af-b275-0a64b3355a02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:30.556166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f389c677-10c8-49af-b275-0a64b3355a02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.299415 Feb 21 01:05:30.557094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 807/1432] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:30 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:31.475292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b422f978-8aac-4045-9641-aca004a65262 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:31.475978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b422f978-8aac-4045-9641-aca004a65262 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:31.482711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b422f978-8aac-4045-9641-aca004a65262 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:31.483252 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b422f978-8aac-4045-9641-aca004a65262 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:31.484096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b422f978-8aac-4045-9641-aca004a65262 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:31.484626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b422f978-8aac-4045-9641-aca004a65262 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:31.570958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:31.571573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:31.578243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:31.578608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:31.579602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:31.580033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:31.641924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:31.652656 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:31.654472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:31.655772 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ccd34aba-06da-487a-bb37-180348cf744e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093007 Feb 21 01:05:31.666150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 808/1433] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:31.666150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-482dffe5-9131-4a22-9eef-b6b8d6561dcf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:31.666150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-482dffe5-9131-4a22-9eef-b6b8d6561dcf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:31.669886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-482dffe5-9131-4a22-9eef-b6b8d6561dcf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:31.670336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-482dffe5-9131-4a22-9eef-b6b8d6561dcf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:31.671249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-482dffe5-9131-4a22-9eef-b6b8d6561dcf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:31.671633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-482dffe5-9131-4a22-9eef-b6b8d6561dcf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:31.825999 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-482dffe5-9131-4a22-9eef-b6b8d6561dcf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:31.834029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-482dffe5-9131-4a22-9eef-b6b8d6561dcf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176096 Feb 21 01:05:31.834620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 809/1434] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:31 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:31.907104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b422f978-8aac-4045-9641-aca004a65262 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:31.917691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b422f978-8aac-4045-9641-aca004a65262 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.446120 Feb 21 01:05:31.918263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 626/1435] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:31 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:32.673170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:32.673778 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:32.680739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:32.681201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:32.681989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:32.682420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:32.851213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-58aac3f9-412d-4e76-b9b5-c8cf86eafa0a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:32.851851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-58aac3f9-412d-4e76-b9b5-c8cf86eafa0a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:32.858712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-58aac3f9-412d-4e76-b9b5-c8cf86eafa0a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:32.859121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-58aac3f9-412d-4e76-b9b5-c8cf86eafa0a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:32.859960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-58aac3f9-412d-4e76-b9b5-c8cf86eafa0a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:32.860462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-58aac3f9-412d-4e76-b9b5-c8cf86eafa0a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:32.974127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:32.983235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:32.985513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:32.986707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e4ed67d9-8b38-4b24-ab5f-ae881b069c81 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.317362 Feb 21 01:05:32.987278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 810/1436] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:32.991994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-af20efc2-d3c4-419b-bc3f-ac9d45483077 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:32.992631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-af20efc2-d3c4-419b-bc3f-ac9d45483077 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:32.999115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-af20efc2-d3c4-419b-bc3f-ac9d45483077 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:32.999558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-af20efc2-d3c4-419b-bc3f-ac9d45483077 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:33.000426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-af20efc2-d3c4-419b-bc3f-ac9d45483077 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:33.000974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-af20efc2-d3c4-419b-bc3f-ac9d45483077 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:33.017951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-58aac3f9-412d-4e76-b9b5-c8cf86eafa0a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:33.026597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-58aac3f9-412d-4e76-b9b5-c8cf86eafa0a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.179224 Feb 21 01:05:33.027417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 627/1437] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:32 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:05:33.256879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-af20efc2-d3c4-419b-bc3f-ac9d45483077 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:33.265748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-af20efc2-d3c4-419b-bc3f-ac9d45483077 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.277296 Feb 21 01:05:33.266326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 811/1438] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:32 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:34.007207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:34.007819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:34.015349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:34.015799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:34.016640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:34.017577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:34.043735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c9cf78b8-7c00-43ad-9f92-12a62e49db2b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:34.045056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c9cf78b8-7c00-43ad-9f92-12a62e49db2b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:34.052886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c9cf78b8-7c00-43ad-9f92-12a62e49db2b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:34.053537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c9cf78b8-7c00-43ad-9f92-12a62e49db2b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:34.054440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c9cf78b8-7c00-43ad-9f92-12a62e49db2b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:34.054875 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c9cf78b8-7c00-43ad-9f92-12a62e49db2b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:34.081556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:34.091351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:34.092996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:34.094409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-050a5fed-51b7-4732-82f5-ab1253af74ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091030 Feb 21 01:05:34.095279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 628/1439] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:34.283123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0efdf8bf-a9b4-46f0-ae84-fe0ec6919f86 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:34.283731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0efdf8bf-a9b4-46f0-ae84-fe0ec6919f86 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:34.290187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0efdf8bf-a9b4-46f0-ae84-fe0ec6919f86 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:34.290628 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0efdf8bf-a9b4-46f0-ae84-fe0ec6919f86 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:34.291400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0efdf8bf-a9b4-46f0-ae84-fe0ec6919f86 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:34.291819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0efdf8bf-a9b4-46f0-ae84-fe0ec6919f86 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:34.315365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c9cf78b8-7c00-43ad-9f92-12a62e49db2b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:34.325776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c9cf78b8-7c00-43ad-9f92-12a62e49db2b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.286051 Feb 21 01:05:34.332268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 812/1440] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:34 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:05:34.429652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0efdf8bf-a9b4-46f0-ae84-fe0ec6919f86 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:34.437710 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0efdf8bf-a9b4-46f0-ae84-fe0ec6919f86 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.158279 Feb 21 01:05:34.438483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 629/1441] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:34 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:35.112714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:35.113486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:35.120785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:35.121398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:35.122331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:35.122923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:35.220941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:35.229540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:35.231027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:35.232201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c050a879-9440-4705-ab43-bb0f79c52645 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.123432 Feb 21 01:05:35.232786 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 813/1442] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:35 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:35.343388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7cf846a1-b34e-463e-ba39-8d45b247b3a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:35.343956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7cf846a1-b34e-463e-ba39-8d45b247b3a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:35.351093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7cf846a1-b34e-463e-ba39-8d45b247b3a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:35.351549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7cf846a1-b34e-463e-ba39-8d45b247b3a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:35.352300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7cf846a1-b34e-463e-ba39-8d45b247b3a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:35.352757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7cf846a1-b34e-463e-ba39-8d45b247b3a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:35.455069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-55bf1aaa-a988-4c5a-9e2a-27865362b152 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:35.455608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-55bf1aaa-a988-4c5a-9e2a-27865362b152 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:35.462047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55bf1aaa-a988-4c5a-9e2a-27865362b152 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:35.462487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55bf1aaa-a988-4c5a-9e2a-27865362b152 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:35.463251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55bf1aaa-a988-4c5a-9e2a-27865362b152 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:35.463671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55bf1aaa-a988-4c5a-9e2a-27865362b152 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:35.579058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7cf846a1-b34e-463e-ba39-8d45b247b3a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:35.589853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7cf846a1-b34e-463e-ba39-8d45b247b3a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.250293 Feb 21 01:05:35.602579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 630/1443] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:35 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:35.650419 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-55bf1aaa-a988-4c5a-9e2a-27865362b152 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:35.659650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-55bf1aaa-a988-4c5a-9e2a-27865362b152 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.208407 Feb 21 01:05:35.669567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 814/1444] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:35 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:36.250976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:36.251721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:36.258015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:36.258539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:36.259403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:36.259897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:36.321973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:36.330638 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:36.332108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:36.333271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8b6bdddd-1cf6-47ed-a4af-e8e82cdbe95a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086528 Feb 21 01:05:36.333827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 631/1445] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:36 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:05:36.608769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-df601195-a20f-401a-8926-ecf70ce907e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:36.609678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-df601195-a20f-401a-8926-ecf70ce907e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:36.616926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df601195-a20f-401a-8926-ecf70ce907e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:36.617365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df601195-a20f-401a-8926-ecf70ce907e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:36.618181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df601195-a20f-401a-8926-ecf70ce907e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:36.618603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df601195-a20f-401a-8926-ecf70ce907e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:36.677245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-df3444dc-2490-4c84-8371-6a5895e1a822 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:36.677874 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-df3444dc-2490-4c84-8371-6a5895e1a822 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:36.684188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df3444dc-2490-4c84-8371-6a5895e1a822 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:36.684662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df3444dc-2490-4c84-8371-6a5895e1a822 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:36.685457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df3444dc-2490-4c84-8371-6a5895e1a822 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:36.685865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df3444dc-2490-4c84-8371-6a5895e1a822 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:36.795060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df601195-a20f-401a-8926-ecf70ce907e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:36.803388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-df601195-a20f-401a-8926-ecf70ce907e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.199474 Feb 21 01:05:36.813150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 815/1446] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:36 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:36.831595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-df3444dc-2490-4c84-8371-6a5895e1a822 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:36.839551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-df3444dc-2490-4c84-8371-6a5895e1a822 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.166239 Feb 21 01:05:36.840123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 632/1447] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:36 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:05:37.351132 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:37.351738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:37.357572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:37.358018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:37.358792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:37.359222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:37.420081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:37.430002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:37.431486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:37.432834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ba775562-90e4-4c60-8c1c-02fc90e115c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085554 Feb 21 01:05:37.433396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 816/1448] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:37 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:37.824239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-022013c6-6211-411b-84af-173ac0185694 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:37.825297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-022013c6-6211-411b-84af-173ac0185694 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:37.836225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-022013c6-6211-411b-84af-173ac0185694 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:37.837035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-022013c6-6211-411b-84af-173ac0185694 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:37.838298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-022013c6-6211-411b-84af-173ac0185694 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:37.839019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-022013c6-6211-411b-84af-173ac0185694 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:37.856081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1afd84e0-784e-4767-893a-156b485f60ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:37.856724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1afd84e0-784e-4767-893a-156b485f60ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:37.863305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1afd84e0-784e-4767-893a-156b485f60ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:37.863744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1afd84e0-784e-4767-893a-156b485f60ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:37.864570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1afd84e0-784e-4767-893a-156b485f60ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:37.864994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1afd84e0-784e-4767-893a-156b485f60ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:37.977143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-022013c6-6211-411b-84af-173ac0185694 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:37.984980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-022013c6-6211-411b-84af-173ac0185694 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166978 Feb 21 01:05:37.985555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 633/1449] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:37 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:37.997757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1afd84e0-784e-4767-893a-156b485f60ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:38.005658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1afd84e0-784e-4767-893a-156b485f60ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.153473 Feb 21 01:05:38.006220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 817/1450] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:37 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:38.454498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:38.455477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:38.465932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:38.466671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:38.467969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:38.468783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:38.531553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:38.540544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:38.542038 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:38.543216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c1ff2463-a46a-4c90-86be-5c6ab3afe006 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095256 Feb 21 01:05:38.543825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 634/1451] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:39.002329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d66135fd-c447-440d-823f-8c72e1281bcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:39.002920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d66135fd-c447-440d-823f-8c72e1281bcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:39.009968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d66135fd-c447-440d-823f-8c72e1281bcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:39.010410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d66135fd-c447-440d-823f-8c72e1281bcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:39.011182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d66135fd-c447-440d-823f-8c72e1281bcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:39.011608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d66135fd-c447-440d-823f-8c72e1281bcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:39.022860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-34ed0234-8ba7-491d-b37b-1f8773f7cfe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:39.023434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-34ed0234-8ba7-491d-b37b-1f8773f7cfe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:39.030503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-34ed0234-8ba7-491d-b37b-1f8773f7cfe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:39.030943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-34ed0234-8ba7-491d-b37b-1f8773f7cfe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:39.031716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-34ed0234-8ba7-491d-b37b-1f8773f7cfe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:39.032141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-34ed0234-8ba7-491d-b37b-1f8773f7cfe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:39.155506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d66135fd-c447-440d-823f-8c72e1281bcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:39.163607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d66135fd-c447-440d-823f-8c72e1281bcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165180 Feb 21 01:05:39.164187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 818/1452] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:38 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:39.167936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-34ed0234-8ba7-491d-b37b-1f8773f7cfe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:39.175889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-34ed0234-8ba7-491d-b37b-1f8773f7cfe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.156820 Feb 21 01:05:39.176467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 635/1453] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:39 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:39.561615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:39.562229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:39.568936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:39.569375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:39.570155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:39.570574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:39.632540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:39.645644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:39.647166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:39.648329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e2b12c44-f9b6-413c-ac50-65d43c9c3fa5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090597 Feb 21 01:05:39.648938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 819/1454] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:40.183613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e1085116-f7c3-45b2-8d9f-70ea3a66fb35 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:40.184631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e1085116-f7c3-45b2-8d9f-70ea3a66fb35 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:40.194991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1085116-f7c3-45b2-8d9f-70ea3a66fb35 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:40.195714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1085116-f7c3-45b2-8d9f-70ea3a66fb35 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:40.196867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5c37aff3-5a3d-4f0a-948f-f31984db360b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:40.197645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1085116-f7c3-45b2-8d9f-70ea3a66fb35 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:40.197818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1085116-f7c3-45b2-8d9f-70ea3a66fb35 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:40.197972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5c37aff3-5a3d-4f0a-948f-f31984db360b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:40.207354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5c37aff3-5a3d-4f0a-948f-f31984db360b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:40.207795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5c37aff3-5a3d-4f0a-948f-f31984db360b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:40.208611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5c37aff3-5a3d-4f0a-948f-f31984db360b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:40.209062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5c37aff3-5a3d-4f0a-948f-f31984db360b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:40.334167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e1085116-f7c3-45b2-8d9f-70ea3a66fb35 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:40.338474 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5c37aff3-5a3d-4f0a-948f-f31984db360b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:40.342310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e1085116-f7c3-45b2-8d9f-70ea3a66fb35 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164875 Feb 21 01:05:40.342908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 636/1455] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:40 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:40.346550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5c37aff3-5a3d-4f0a-948f-f31984db360b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.156116 Feb 21 01:05:40.347105 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 820/1456] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:40 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:05:40.668050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:40.669031 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:40.678511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:40.679114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:40.680239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:40.680758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:40.748173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:40.757139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:40.758609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:40.759761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2263d0c2-1baa-41de-b36e-a51f5e856ee0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096185 Feb 21 01:05:40.760313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 637/1457] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:40 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:41.363073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9a5e0c84-dd48-4644-b91b-f464031ac095 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:41.364063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9a5e0c84-dd48-4644-b91b-f464031ac095 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:41.366652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-731fe773-50e3-48d7-b4ba-1ec118a72e31 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:41.367663 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-731fe773-50e3-48d7-b4ba-1ec118a72e31 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:41.374947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a5e0c84-dd48-4644-b91b-f464031ac095 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:41.375678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a5e0c84-dd48-4644-b91b-f464031ac095 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:41.377043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a5e0c84-dd48-4644-b91b-f464031ac095 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:41.377880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a5e0c84-dd48-4644-b91b-f464031ac095 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:41.378550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-731fe773-50e3-48d7-b4ba-1ec118a72e31 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:41.379180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-731fe773-50e3-48d7-b4ba-1ec118a72e31 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:41.380317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-731fe773-50e3-48d7-b4ba-1ec118a72e31 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:41.380974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-731fe773-50e3-48d7-b4ba-1ec118a72e31 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:41.514430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-731fe773-50e3-48d7-b4ba-1ec118a72e31 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:41.518040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9a5e0c84-dd48-4644-b91b-f464031ac095 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:41.523597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-731fe773-50e3-48d7-b4ba-1ec118a72e31 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163126 Feb 21 01:05:41.524184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 638/1458] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:41 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:41.527276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9a5e0c84-dd48-4644-b91b-f464031ac095 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.170241 Feb 21 01:05:41.527814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 821/1459] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:41 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:41.781723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:41.782779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:41.793000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:41.793754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:41.795042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:41.795759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:41.857020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:41.865774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:41.867250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:41.868414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f110bd68-d930-4ebc-b2aa-069e74213e08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093065 Feb 21 01:05:41.868966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 639/1460] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:41 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:42.547173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-62fadf67-fda3-4ab1-84ee-57d4a9c8cdb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:42.548068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3ef464b8-8bec-4d2b-abb6-28ac6169a331 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:42.548746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3ef464b8-8bec-4d2b-abb6-28ac6169a331 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:42.548923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-62fadf67-fda3-4ab1-84ee-57d4a9c8cdb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:42.555984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ef464b8-8bec-4d2b-abb6-28ac6169a331 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:42.556181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-62fadf67-fda3-4ab1-84ee-57d4a9c8cdb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:42.556427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ef464b8-8bec-4d2b-abb6-28ac6169a331 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:42.556637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-62fadf67-fda3-4ab1-84ee-57d4a9c8cdb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:42.557239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ef464b8-8bec-4d2b-abb6-28ac6169a331 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:42.557420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-62fadf67-fda3-4ab1-84ee-57d4a9c8cdb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:42.557665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ef464b8-8bec-4d2b-abb6-28ac6169a331 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:42.558000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-62fadf67-fda3-4ab1-84ee-57d4a9c8cdb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:42.689538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-62fadf67-fda3-4ab1-84ee-57d4a9c8cdb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:42.694675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3ef464b8-8bec-4d2b-abb6-28ac6169a331 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:42.697599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-62fadf67-fda3-4ab1-84ee-57d4a9c8cdb8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.156728 Feb 21 01:05:42.698148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 822/1461] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:42 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:42.702504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3ef464b8-8bec-4d2b-abb6-28ac6169a331 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.161527 Feb 21 01:05:42.703131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 640/1462] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:42 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:42.885871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:42.886387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:42.892803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:42.893245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:42.894016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:42.894441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:42.961507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:42.969886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:42.971410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:42.972616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c5dcc094-415f-4af9-b299-46ea24a27dbd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090525 Feb 21 01:05:42.973180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 823/1463] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:43.715010 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-747b0c25-b4f1-4889-858e-eb45090adf37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:43.715570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-747b0c25-b4f1-4889-858e-eb45090adf37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:43.718733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a2f68f61-8f3c-4938-92b7-a1ada6eff5f7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:43.719373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a2f68f61-8f3c-4938-92b7-a1ada6eff5f7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:43.722286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-747b0c25-b4f1-4889-858e-eb45090adf37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:43.722837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-747b0c25-b4f1-4889-858e-eb45090adf37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:43.723611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-747b0c25-b4f1-4889-858e-eb45090adf37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:43.724032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-747b0c25-b4f1-4889-858e-eb45090adf37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:43.726044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2f68f61-8f3c-4938-92b7-a1ada6eff5f7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:43.726469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2f68f61-8f3c-4938-92b7-a1ada6eff5f7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:43.727243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2f68f61-8f3c-4938-92b7-a1ada6eff5f7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:43.727668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a2f68f61-8f3c-4938-92b7-a1ada6eff5f7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:43.859804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-747b0c25-b4f1-4889-858e-eb45090adf37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:43.862774 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a2f68f61-8f3c-4938-92b7-a1ada6eff5f7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:43.868257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-747b0c25-b4f1-4889-858e-eb45090adf37 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.157207 Feb 21 01:05:43.868851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 641/1464] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:43 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:43.870679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a2f68f61-8f3c-4938-92b7-a1ada6eff5f7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.155581 Feb 21 01:05:43.871298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 824/1465] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:43 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:43.992350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:43.993008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:43.999854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:44.000317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:44.001120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:44.001546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:44.069985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:44.082932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:44.084433 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:44.085632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a59d67d0-0251-40ff-9af1-7a0b26c7e8c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097353 Feb 21 01:05:44.086193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 642/1466] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:44.889604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e622eb1f-e0d0-44ff-b969-ed23d5930153 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:44.890858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e622eb1f-e0d0-44ff-b969-ed23d5930153 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:44.891148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9984306e-a4ba-48bf-b7c5-da0dfe1206cf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:44.892131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9984306e-a4ba-48bf-b7c5-da0dfe1206cf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:44.899223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e622eb1f-e0d0-44ff-b969-ed23d5930153 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:44.900157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e622eb1f-e0d0-44ff-b969-ed23d5930153 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:44.900361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9984306e-a4ba-48bf-b7c5-da0dfe1206cf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:44.900674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9984306e-a4ba-48bf-b7c5-da0dfe1206cf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:44.900986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e622eb1f-e0d0-44ff-b969-ed23d5930153 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:44.901439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e622eb1f-e0d0-44ff-b969-ed23d5930153 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:44.901593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9984306e-a4ba-48bf-b7c5-da0dfe1206cf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:44.901882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9984306e-a4ba-48bf-b7c5-da0dfe1206cf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:45.040169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9984306e-a4ba-48bf-b7c5-da0dfe1206cf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:45.041815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e622eb1f-e0d0-44ff-b969-ed23d5930153 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:45.048837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9984306e-a4ba-48bf-b7c5-da0dfe1206cf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163759 Feb 21 01:05:45.049624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 643/1467] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:44 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:45.050315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e622eb1f-e0d0-44ff-b969-ed23d5930153 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.167136 Feb 21 01:05:45.051033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 825/1468] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:44 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:45.109210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:45.110899 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:45.121196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:45.121953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:45.123283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:45.123998 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:45.190121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:45.198677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:45.200151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:45.201355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-af49032b-e071-41e1-bd45-f1e81a79d371 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100950 Feb 21 01:05:45.201919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 644/1469] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:45 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:46.069122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b6ca43aa-b564-47a7-b2f7-c13e25599dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:46.069867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7c1aae53-f928-4603-bf2b-17c5d2c179ed tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:46.070441 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7c1aae53-f928-4603-bf2b-17c5d2c179ed tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:46.070599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b6ca43aa-b564-47a7-b2f7-c13e25599dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:46.076860 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6ca43aa-b564-47a7-b2f7-c13e25599dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:46.077140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c1aae53-f928-4603-bf2b-17c5d2c179ed tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:46.077283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6ca43aa-b564-47a7-b2f7-c13e25599dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:46.077592 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c1aae53-f928-4603-bf2b-17c5d2c179ed tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:46.078049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6ca43aa-b564-47a7-b2f7-c13e25599dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:46.078386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c1aae53-f928-4603-bf2b-17c5d2c179ed tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:46.078494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6ca43aa-b564-47a7-b2f7-c13e25599dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:46.078816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c1aae53-f928-4603-bf2b-17c5d2c179ed tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:46.210178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b6ca43aa-b564-47a7-b2f7-c13e25599dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:46.210348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7c1aae53-f928-4603-bf2b-17c5d2c179ed tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:46.218247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b6ca43aa-b564-47a7-b2f7-c13e25599dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.154461 Feb 21 01:05:46.218436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7c1aae53-f928-4603-bf2b-17c5d2c179ed tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.152826 Feb 21 01:05:46.218994 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 645/1471] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:46 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:46.219121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 826/1471] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:46 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:46.223237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:46.223825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:46.229775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:46.230210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:46.230969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:46.231388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:46.296072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:46.305376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:46.306858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:46.307989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4ccd379f-9d87-4681-bae7-73e6347fc57e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088237 Feb 21 01:05:46.308580 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 646/1472] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:47.238857 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c7379add-1bf8-42e1-b41d-ae4ca08445ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:47.239488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-141ad7c3-fae1-4414-af8c-64dae74f738d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:47.239855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c7379add-1bf8-42e1-b41d-ae4ca08445ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:47.239970 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-141ad7c3-fae1-4414-af8c-64dae74f738d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:47.246114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-141ad7c3-fae1-4414-af8c-64dae74f738d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:47.246268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7379add-1bf8-42e1-b41d-ae4ca08445ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:47.246566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-141ad7c3-fae1-4414-af8c-64dae74f738d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:47.246753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7379add-1bf8-42e1-b41d-ae4ca08445ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:47.247374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7379add-1bf8-42e1-b41d-ae4ca08445ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:47.247516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-141ad7c3-fae1-4414-af8c-64dae74f738d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:47.247794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7379add-1bf8-42e1-b41d-ae4ca08445ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:47.247954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-141ad7c3-fae1-4414-af8c-64dae74f738d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:47.383440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c7379add-1bf8-42e1-b41d-ae4ca08445ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:47.383950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-141ad7c3-fae1-4414-af8c-64dae74f738d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:47.391719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c7379add-1bf8-42e1-b41d-ae4ca08445ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158905 Feb 21 01:05:47.392253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 827/1473] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:47 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:47.392886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-141ad7c3-fae1-4414-af8c-64dae74f738d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.159824 Feb 21 01:05:47.402699 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 647/1474] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:47 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:47.402893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:47.402893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:47.403338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:47.403768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:47.404568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:47.404989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:47.463425 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:47.471667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:47.473259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:47.474375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1c46261e-bcce-4ba3-9df2-e8a484345c0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.081082 Feb 21 01:05:47.474924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 828/1475] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:47 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:48.413338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e7af34e0-8dde-4889-a8e2-d9f89ed8e336 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:48.414263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-26f0efea-09db-4aa1-8ba5-2cb2900aa865 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:48.414873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e7af34e0-8dde-4889-a8e2-d9f89ed8e336 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:48.415042 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-26f0efea-09db-4aa1-8ba5-2cb2900aa865 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:48.425051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7af34e0-8dde-4889-a8e2-d9f89ed8e336 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:48.425326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-26f0efea-09db-4aa1-8ba5-2cb2900aa865 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:48.425853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7af34e0-8dde-4889-a8e2-d9f89ed8e336 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:48.426088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-26f0efea-09db-4aa1-8ba5-2cb2900aa865 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:48.426765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7af34e0-8dde-4889-a8e2-d9f89ed8e336 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:48.426912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-26f0efea-09db-4aa1-8ba5-2cb2900aa865 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:48.427194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7af34e0-8dde-4889-a8e2-d9f89ed8e336 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:48.427359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-26f0efea-09db-4aa1-8ba5-2cb2900aa865 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:48.561783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e7af34e0-8dde-4889-a8e2-d9f89ed8e336 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:48.564458 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-26f0efea-09db-4aa1-8ba5-2cb2900aa865 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:48.569957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e7af34e0-8dde-4889-a8e2-d9f89ed8e336 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162860 Feb 21 01:05:48.570544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 648/1476] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:48 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:48.575105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:48.575719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:48.581272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-26f0efea-09db-4aa1-8ba5-2cb2900aa865 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.173668 Feb 21 01:05:48.581424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:48.581795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:48.581979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 829/1477] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:48 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:48.582737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:48.583173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:48.645605 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:48.654373 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:48.655866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:48.657043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-21f283bd-8e2b-4003-94e8-caa817078d73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085553 Feb 21 01:05:48.657585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 649/1478] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:49.591023 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3b247c04-b025-4f31-b1ec-2c4ad6f604b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:49.592019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3b247c04-b025-4f31-b1ec-2c4ad6f604b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:49.600363 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b4b85365-5a14-4dff-9738-85ebcbaf517c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:49.600873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3b247c04-b025-4f31-b1ec-2c4ad6f604b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:49.601144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b4b85365-5a14-4dff-9738-85ebcbaf517c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:49.601298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3b247c04-b025-4f31-b1ec-2c4ad6f604b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:49.602067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3b247c04-b025-4f31-b1ec-2c4ad6f604b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:49.602490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3b247c04-b025-4f31-b1ec-2c4ad6f604b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:49.607469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b85365-5a14-4dff-9738-85ebcbaf517c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:49.607911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b85365-5a14-4dff-9738-85ebcbaf517c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:49.608721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b85365-5a14-4dff-9738-85ebcbaf517c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:49.609138 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4b85365-5a14-4dff-9738-85ebcbaf517c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:49.737625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3b247c04-b025-4f31-b1ec-2c4ad6f604b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:49.740022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b4b85365-5a14-4dff-9738-85ebcbaf517c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:49.745614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3b247c04-b025-4f31-b1ec-2c4ad6f604b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160872 Feb 21 01:05:49.746186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 830/1479] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:49 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:49.747828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b4b85365-5a14-4dff-9738-85ebcbaf517c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.152165 Feb 21 01:05:49.748529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 650/1480] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:49 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:49.750428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:49.751027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:49.756919 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:49.757361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:49.758137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:49.758564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:49.827180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:49.836088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:49.837623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:49.838758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d51d8a98-6570-48aa-8f07-72bde4f58360 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091639 Feb 21 01:05:49.839294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 831/1481] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:50.766241 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-38408377-66af-4e78-a50e-3ff74b253ed4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:50.767184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-38408377-66af-4e78-a50e-3ff74b253ed4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:50.770139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-37e2a9d1-6164-4489-9270-b63bc6716412 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:50.770799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-37e2a9d1-6164-4489-9270-b63bc6716412 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:50.777189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38408377-66af-4e78-a50e-3ff74b253ed4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:50.777632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38408377-66af-4e78-a50e-3ff74b253ed4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:50.777773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37e2a9d1-6164-4489-9270-b63bc6716412 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:50.778186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37e2a9d1-6164-4489-9270-b63bc6716412 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:50.778399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38408377-66af-4e78-a50e-3ff74b253ed4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:50.778816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38408377-66af-4e78-a50e-3ff74b253ed4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:50.778929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37e2a9d1-6164-4489-9270-b63bc6716412 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:50.779365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37e2a9d1-6164-4489-9270-b63bc6716412 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:50.911136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-38408377-66af-4e78-a50e-3ff74b253ed4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:50.913214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-37e2a9d1-6164-4489-9270-b63bc6716412 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:50.919400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-38408377-66af-4e78-a50e-3ff74b253ed4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159332 Feb 21 01:05:50.919999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 651/1482] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:50 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:50.921079 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-37e2a9d1-6164-4489-9270-b63bc6716412 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.157015 Feb 21 01:05:50.921636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 832/1483] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:50 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:50.929074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:50.929655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:50.935411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:50.935924 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:50.936715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:50.937153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:50.998822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:51.007467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:51.008980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:51.010114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b60a352a-f3bc-4939-a02f-00a3f4921c61 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.084733 Feb 21 01:05:51.010669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 652/1484] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:50 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:51.939627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-22e76558-4a35-4e96-ad8f-360e764d43fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:51.940686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-22e76558-4a35-4e96-ad8f-360e764d43fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:51.941673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4b6abaf8-124b-4e21-8495-5d5cac386101 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:51.942290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4b6abaf8-124b-4e21-8495-5d5cac386101 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:51.947322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22e76558-4a35-4e96-ad8f-360e764d43fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:51.947762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22e76558-4a35-4e96-ad8f-360e764d43fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:51.948571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22e76558-4a35-4e96-ad8f-360e764d43fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:51.948917 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b6abaf8-124b-4e21-8495-5d5cac386101 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:51.949035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22e76558-4a35-4e96-ad8f-360e764d43fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:51.949361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b6abaf8-124b-4e21-8495-5d5cac386101 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:51.950144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b6abaf8-124b-4e21-8495-5d5cac386101 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:51.950577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b6abaf8-124b-4e21-8495-5d5cac386101 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:52.081828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4b6abaf8-124b-4e21-8495-5d5cac386101 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:52.082144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-22e76558-4a35-4e96-ad8f-360e764d43fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:52.089902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4b6abaf8-124b-4e21-8495-5d5cac386101 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.154380 Feb 21 01:05:52.090090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-22e76558-4a35-4e96-ad8f-360e764d43fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156447 Feb 21 01:05:52.090444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 653/1485] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:51 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:52.094892 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:52.095168 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 833/1486] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:51 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:52.095889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:52.101929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:52.102381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:52.103159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:52.103593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:52.167760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:52.176179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:52.177789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:52.178963 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-beffe73e-5a87-4ffe-8ed8-097dbd2f26eb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087581 Feb 21 01:05:52.179519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 654/1487] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:53.106963 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-57e63516-2c5d-4ef4-867d-57d3a9534cfe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:53.107697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-48835bd4-346f-4bd7-b064-2bd6638dc143 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:53.108081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-57e63516-2c5d-4ef4-867d-57d3a9534cfe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:53.108187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-48835bd4-346f-4bd7-b064-2bd6638dc143 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:53.114356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57e63516-2c5d-4ef4-867d-57d3a9534cfe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:53.114543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48835bd4-346f-4bd7-b064-2bd6638dc143 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:53.114768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48835bd4-346f-4bd7-b064-2bd6638dc143 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:53.114898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57e63516-2c5d-4ef4-867d-57d3a9534cfe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:53.115587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48835bd4-346f-4bd7-b064-2bd6638dc143 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:53.115746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57e63516-2c5d-4ef4-867d-57d3a9534cfe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:53.116012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48835bd4-346f-4bd7-b064-2bd6638dc143 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:53.116168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-57e63516-2c5d-4ef4-867d-57d3a9534cfe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:53.252232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-48835bd4-346f-4bd7-b064-2bd6638dc143 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:53.255619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-57e63516-2c5d-4ef4-867d-57d3a9534cfe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:53.260704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-48835bd4-346f-4bd7-b064-2bd6638dc143 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.157460 Feb 21 01:05:53.261390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 834/1488] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:53 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:53.263682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-57e63516-2c5d-4ef4-867d-57d3a9534cfe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160415 Feb 21 01:05:53.264436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 655/1489] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:53 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:53.265962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:53.266636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:53.272694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:53.273215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:53.273993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:53.274763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:53.338139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:53.346753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:53.348321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:53.349495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9a6e03b8-3711-4fce-ae1a-05432289170b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087049 Feb 21 01:05:53.350056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 835/1490] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:53 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:54.283853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-32616750-4251-4410-94bc-8db01ff63d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:54.284814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-349052c1-0d22-4908-87c6-7038f0a1428f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:54.285455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-32616750-4251-4410-94bc-8db01ff63d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:54.285585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-349052c1-0d22-4908-87c6-7038f0a1428f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:54.291956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32616750-4251-4410-94bc-8db01ff63d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:54.292375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32616750-4251-4410-94bc-8db01ff63d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:54.292559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-349052c1-0d22-4908-87c6-7038f0a1428f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:54.292962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-349052c1-0d22-4908-87c6-7038f0a1428f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:54.293230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32616750-4251-4410-94bc-8db01ff63d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:54.293654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-32616750-4251-4410-94bc-8db01ff63d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:54.293797 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-349052c1-0d22-4908-87c6-7038f0a1428f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:54.294165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-349052c1-0d22-4908-87c6-7038f0a1428f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:54.429066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-32616750-4251-4410-94bc-8db01ff63d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:54.430366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-349052c1-0d22-4908-87c6-7038f0a1428f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:54.437236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-32616750-4251-4410-94bc-8db01ff63d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.159529 Feb 21 01:05:54.437838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 656/1491] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:54 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:54.438473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-349052c1-0d22-4908-87c6-7038f0a1428f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160073 Feb 21 01:05:54.439017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 836/1492] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:54 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:54.442354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:54.442955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:54.448654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:54.449106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:54.449883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:54.450313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:54.510356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:54.518345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:54.519958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:54.521122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1a9afbff-f7f4-409b-983c-194d769a73ef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.082405 Feb 21 01:05:54.521676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 657/1493] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:54 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:55.457911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e21ff174-eeb1-4dad-a88e-8c839db2ad32 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:55.458497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e21ff174-eeb1-4dad-a88e-8c839db2ad32 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:55.459247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-04783b32-e0a6-48ad-b393-76a6e2bce2b7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:55.459937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-04783b32-e0a6-48ad-b393-76a6e2bce2b7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:55.465302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e21ff174-eeb1-4dad-a88e-8c839db2ad32 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:55.465695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e21ff174-eeb1-4dad-a88e-8c839db2ad32 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:55.466443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e21ff174-eeb1-4dad-a88e-8c839db2ad32 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:55.466594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04783b32-e0a6-48ad-b393-76a6e2bce2b7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:55.466869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e21ff174-eeb1-4dad-a88e-8c839db2ad32 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:55.466992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04783b32-e0a6-48ad-b393-76a6e2bce2b7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:55.467718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04783b32-e0a6-48ad-b393-76a6e2bce2b7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:55.468136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04783b32-e0a6-48ad-b393-76a6e2bce2b7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:55.603402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04783b32-e0a6-48ad-b393-76a6e2bce2b7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:55.603559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e21ff174-eeb1-4dad-a88e-8c839db2ad32 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:55.611355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-04783b32-e0a6-48ad-b393-76a6e2bce2b7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157172 Feb 21 01:05:55.611540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e21ff174-eeb1-4dad-a88e-8c839db2ad32 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.159484 Feb 21 01:05:55.612132 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 837/1495] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:55 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:55.612251 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 658/1495] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:55 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:55.616328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:55.616976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:55.622555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:55.623006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:55.623780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:55.624210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:55.691056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:55.700050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:55.701579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:55.702724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b8e7f1c0-9517-4026-a2b1-21232f8ed929 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089730 Feb 21 01:05:55.703303 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 838/1496] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:56.632234 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-209b4d52-8235-47f5-b316-69ab40601cc2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:56.633250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-209b4d52-8235-47f5-b316-69ab40601cc2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:56.640718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7a9cd148-9233-4b5d-bb73-b01aae2f6514 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:56.641714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7a9cd148-9233-4b5d-bb73-b01aae2f6514 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:56.643755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-209b4d52-8235-47f5-b316-69ab40601cc2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:56.644576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-209b4d52-8235-47f5-b316-69ab40601cc2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:56.645358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-209b4d52-8235-47f5-b316-69ab40601cc2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:56.645782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-209b4d52-8235-47f5-b316-69ab40601cc2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:56.649758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a9cd148-9233-4b5d-bb73-b01aae2f6514 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:56.650203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a9cd148-9233-4b5d-bb73-b01aae2f6514 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:56.650981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a9cd148-9233-4b5d-bb73-b01aae2f6514 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:56.651402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a9cd148-9233-4b5d-bb73-b01aae2f6514 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:56.782320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-209b4d52-8235-47f5-b316-69ab40601cc2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:56.783024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7a9cd148-9233-4b5d-bb73-b01aae2f6514 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:56.790513 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-209b4d52-8235-47f5-b316-69ab40601cc2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164536 Feb 21 01:05:56.791008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7a9cd148-9233-4b5d-bb73-b01aae2f6514 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.156408 Feb 21 01:05:56.791113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 659/1497] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:56 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:56.792224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 839/1498] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:56 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:56.795665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:56.796301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:56.802912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:56.803358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:56.804147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:56.804618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:56.864478 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:56.872748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:56.874223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:56.875363 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b4ea4207-676c-4f67-99df-a530bdc1bcfd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083374 Feb 21 01:05:56.875929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 660/1499] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:56 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:57.814266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ac0e2c89-4648-4f4a-a5e8-01adb448b562 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:57.815296 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ac0e2c89-4648-4f4a-a5e8-01adb448b562 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:57.816647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2f534aad-6f2e-4260-9b12-2cabee92a374 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:57.817624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2f534aad-6f2e-4260-9b12-2cabee92a374 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:57.823088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ac0e2c89-4648-4f4a-a5e8-01adb448b562 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:57.823535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ac0e2c89-4648-4f4a-a5e8-01adb448b562 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:57.823819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2f534aad-6f2e-4260-9b12-2cabee92a374 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:57.824259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2f534aad-6f2e-4260-9b12-2cabee92a374 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:57.824449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ac0e2c89-4648-4f4a-a5e8-01adb448b562 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:57.824762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ac0e2c89-4648-4f4a-a5e8-01adb448b562 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:57.825059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2f534aad-6f2e-4260-9b12-2cabee92a374 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:57.825486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2f534aad-6f2e-4260-9b12-2cabee92a374 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:57.961579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ac0e2c89-4648-4f4a-a5e8-01adb448b562 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:57.962404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2f534aad-6f2e-4260-9b12-2cabee92a374 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:57.969899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ac0e2c89-4648-4f4a-a5e8-01adb448b562 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162286 Feb 21 01:05:57.970706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2f534aad-6f2e-4260-9b12-2cabee92a374 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.159814 Feb 21 01:05:57.970848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 840/1500] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:57 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:57.977026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 661/1501] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:57 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:57.977195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:57.977195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:57.981968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:57.982427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:57.983245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:57.983679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:58.049622 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:58.058552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:58.060026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:58.061190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e351d241-97bf-41a8-aa84-48922548d34d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089685 Feb 21 01:05:58.061795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 841/1502] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:57 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:05:58.990314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6dd942ec-debd-40d5-88c9-98e39a9aedce tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:58.990929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e0119505-3583-4b24-8148-a05b6b802b9b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:58.991295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6dd942ec-debd-40d5-88c9-98e39a9aedce tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:58.991414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e0119505-3583-4b24-8148-a05b6b802b9b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:58.997365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6dd942ec-debd-40d5-88c9-98e39a9aedce tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:58.997784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6dd942ec-debd-40d5-88c9-98e39a9aedce tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:58.997936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e0119505-3583-4b24-8148-a05b6b802b9b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:58.998403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e0119505-3583-4b24-8148-a05b6b802b9b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:58.998561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6dd942ec-debd-40d5-88c9-98e39a9aedce tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:58.999006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6dd942ec-debd-40d5-88c9-98e39a9aedce tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:58.999163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e0119505-3583-4b24-8148-a05b6b802b9b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:58.999566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e0119505-3583-4b24-8148-a05b6b802b9b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:59.133404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6dd942ec-debd-40d5-88c9-98e39a9aedce tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:59.133601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e0119505-3583-4b24-8148-a05b6b802b9b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:59.141591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6dd942ec-debd-40d5-88c9-98e39a9aedce tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156978 Feb 21 01:05:59.141762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e0119505-3583-4b24-8148-a05b6b802b9b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.156127 Feb 21 01:05:59.142396 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 662/1503] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:58 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:59.142572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 842/1504] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:05:58 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:05:59.146582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:05:59.147172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:05:59.153290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:59.153735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:59.154527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:05:59.154942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:05:59.221148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:59.230965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:59.232519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:05:59.233689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b69b1fdc-1412-458b-b851-d53737a70de0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090542 Feb 21 01:05:59.234246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 663/1505] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:05:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:00.162589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0cda11fd-317c-4c6f-aa54-0e2f7cef30ac tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:00.163222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0cda11fd-317c-4c6f-aa54-0e2f7cef30ac tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:00.167292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-166c6a50-6f3e-4543-8bbb-28dd8873b393 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:00.167905 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-166c6a50-6f3e-4543-8bbb-28dd8873b393 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:00.170019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0cda11fd-317c-4c6f-aa54-0e2f7cef30ac tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:00.170441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0cda11fd-317c-4c6f-aa54-0e2f7cef30ac tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:00.171250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0cda11fd-317c-4c6f-aa54-0e2f7cef30ac tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:00.171679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0cda11fd-317c-4c6f-aa54-0e2f7cef30ac tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:00.176696 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-166c6a50-6f3e-4543-8bbb-28dd8873b393 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:00.177139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-166c6a50-6f3e-4543-8bbb-28dd8873b393 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:00.177949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-166c6a50-6f3e-4543-8bbb-28dd8873b393 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:00.178385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-166c6a50-6f3e-4543-8bbb-28dd8873b393 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:00.312427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0cda11fd-317c-4c6f-aa54-0e2f7cef30ac tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:00.319456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-166c6a50-6f3e-4543-8bbb-28dd8873b393 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:00.320312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0cda11fd-317c-4c6f-aa54-0e2f7cef30ac tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163233 Feb 21 01:06:00.320932 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 843/1506] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:00 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:00.325392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:00.326230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:00.328158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-166c6a50-6f3e-4543-8bbb-28dd8873b393 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.164689 Feb 21 01:06:00.328956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 664/1507] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:00 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:00.332475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:00.332990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:00.333765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:00.334194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:00.398068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:00.407259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:00.408779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:00.409949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4339fd27-abe8-4f3d-96de-9d3479d08a8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088109 Feb 21 01:06:00.410540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 844/1508] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:00 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:01.339460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6f2b70f6-161f-4308-9868-f3c1765680ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:01.340161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6f2b70f6-161f-4308-9868-f3c1765680ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:01.346725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-22769a6f-dcd2-4e55-aabb-38262ddf3269 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:01.347498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-22769a6f-dcd2-4e55-aabb-38262ddf3269 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:01.349255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f2b70f6-161f-4308-9868-f3c1765680ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:01.349847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f2b70f6-161f-4308-9868-f3c1765680ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:01.350844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f2b70f6-161f-4308-9868-f3c1765680ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:01.351427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f2b70f6-161f-4308-9868-f3c1765680ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:01.355960 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22769a6f-dcd2-4e55-aabb-38262ddf3269 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:01.356603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22769a6f-dcd2-4e55-aabb-38262ddf3269 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:01.357630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22769a6f-dcd2-4e55-aabb-38262ddf3269 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:01.358204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22769a6f-dcd2-4e55-aabb-38262ddf3269 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:01.487369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6f2b70f6-161f-4308-9868-f3c1765680ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:01.489997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-22769a6f-dcd2-4e55-aabb-38262ddf3269 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:01.495535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6f2b70f6-161f-4308-9868-f3c1765680ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.161283 Feb 21 01:06:01.496304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 665/1509] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:01 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:06:01.498140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-22769a6f-dcd2-4e55-aabb-38262ddf3269 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.156211 Feb 21 01:06:01.498704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 845/1510] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:01 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:01.501285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:01.501882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:01.507872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:01.508310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:01.509096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:01.509522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:01.571622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:01.579953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:01.581482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:01.582615 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7536a62b-69f3-4cf2-b669-4fb2b7bd7eef tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085540 Feb 21 01:06:01.583171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 666/1511] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:02.517494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9e617c04-d188-412b-98b5-f9050977b351 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:02.518523 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-df86941b-c1dc-45e7-9623-8cefd27c059f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:02.519146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9e617c04-d188-412b-98b5-f9050977b351 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:02.519335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-df86941b-c1dc-45e7-9623-8cefd27c059f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:02.530645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e617c04-d188-412b-98b5-f9050977b351 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:02.530929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df86941b-c1dc-45e7-9623-8cefd27c059f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:02.531440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e617c04-d188-412b-98b5-f9050977b351 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:02.531667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df86941b-c1dc-45e7-9623-8cefd27c059f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:02.532973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df86941b-c1dc-45e7-9623-8cefd27c059f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:02.533196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e617c04-d188-412b-98b5-f9050977b351 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:02.533663 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df86941b-c1dc-45e7-9623-8cefd27c059f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:02.533849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9e617c04-d188-412b-98b5-f9050977b351 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:02.666473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9e617c04-d188-412b-98b5-f9050977b351 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:02.670238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-df86941b-c1dc-45e7-9623-8cefd27c059f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:02.674738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9e617c04-d188-412b-98b5-f9050977b351 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163779 Feb 21 01:06:02.675325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 846/1512] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:02 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:02.678880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-df86941b-c1dc-45e7-9623-8cefd27c059f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.167128 Feb 21 01:06:02.679676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 667/1513] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:02 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:02.680658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:02.681355 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:02.687865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:02.688307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:02.689119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:02.689553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:02.751044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:02.764086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:02.765620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:02.766757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-55bbb6b5-efe1-42e1-8954-bc7ca75e4980 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090236 Feb 21 01:06:02.767324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 847/1514] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:03.692722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b9950f70-9611-4977-9207-86b1e2aa7cdc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:03.693291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b9950f70-9611-4977-9207-86b1e2aa7cdc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:03.695973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e98593a9-eed7-412c-8ab9-4fbb88a00b79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:03.696613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e98593a9-eed7-412c-8ab9-4fbb88a00b79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:03.700227 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b9950f70-9611-4977-9207-86b1e2aa7cdc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:03.700759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b9950f70-9611-4977-9207-86b1e2aa7cdc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:03.701618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b9950f70-9611-4977-9207-86b1e2aa7cdc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:03.702053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b9950f70-9611-4977-9207-86b1e2aa7cdc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:03.703215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e98593a9-eed7-412c-8ab9-4fbb88a00b79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:03.703655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e98593a9-eed7-412c-8ab9-4fbb88a00b79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:03.704406 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e98593a9-eed7-412c-8ab9-4fbb88a00b79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:03.704854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e98593a9-eed7-412c-8ab9-4fbb88a00b79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:03.840569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e98593a9-eed7-412c-8ab9-4fbb88a00b79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:03.841444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b9950f70-9611-4977-9207-86b1e2aa7cdc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:03.848601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e98593a9-eed7-412c-8ab9-4fbb88a00b79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.156257 Feb 21 01:06:03.849283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 848/1515] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:03 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:03.849408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b9950f70-9611-4977-9207-86b1e2aa7cdc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160770 Feb 21 01:06:03.850037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 668/1516] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:03 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:03.853570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:03.854171 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:03.859760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:03.860194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:03.860987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:03.861407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:03.921720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:03.935451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:03.937835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:03.939427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b471968a-3dd7-4b02-aeb2-903ee675df0c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089133 Feb 21 01:06:03.940104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 849/1517] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:04.866029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c2bb2f6d-f301-44c8-9c2f-4f1599f0ff77 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:04.866701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c0d162c5-5f88-42dc-a759-a2403cd2c8a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:04.867080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c2bb2f6d-f301-44c8-9c2f-4f1599f0ff77 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:04.867179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c0d162c5-5f88-42dc-a759-a2403cd2c8a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:04.873354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c0d162c5-5f88-42dc-a759-a2403cd2c8a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:04.873532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c2bb2f6d-f301-44c8-9c2f-4f1599f0ff77 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:04.873805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c0d162c5-5f88-42dc-a759-a2403cd2c8a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:04.873970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c2bb2f6d-f301-44c8-9c2f-4f1599f0ff77 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:04.874587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c0d162c5-5f88-42dc-a759-a2403cd2c8a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:04.874747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c2bb2f6d-f301-44c8-9c2f-4f1599f0ff77 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:04.875017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c0d162c5-5f88-42dc-a759-a2403cd2c8a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:04.875173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c2bb2f6d-f301-44c8-9c2f-4f1599f0ff77 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:05.011008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c2bb2f6d-f301-44c8-9c2f-4f1599f0ff77 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:05.011930 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c0d162c5-5f88-42dc-a759-a2403cd2c8a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:05.019212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c2bb2f6d-f301-44c8-9c2f-4f1599f0ff77 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.156986 Feb 21 01:06:05.019793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 850/1518] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:04 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:05.020090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c0d162c5-5f88-42dc-a759-a2403cd2c8a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157926 Feb 21 01:06:05.020849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 669/1519] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:04 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:05.025304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:05.026128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:05.031887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:05.032330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:05.033145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:05.033575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:05.094513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:05.107878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:05.110283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:05.112009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a7d45e8a-c1da-43b7-aa9a-6aeb9f61d8b3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091122 Feb 21 01:06:05.112908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 851/1520] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:06.039915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1e242ed6-e51f-42c8-aaa8-1d680cafdc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:06.040565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4af983b8-c3f6-407c-8ffe-92e6a555b58a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:06.040949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1e242ed6-e51f-42c8-aaa8-1d680cafdc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:06.041050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4af983b8-c3f6-407c-8ffe-92e6a555b58a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:06.047309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4af983b8-c3f6-407c-8ffe-92e6a555b58a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:06.047480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e242ed6-e51f-42c8-aaa8-1d680cafdc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:06.047748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4af983b8-c3f6-407c-8ffe-92e6a555b58a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:06.047903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e242ed6-e51f-42c8-aaa8-1d680cafdc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:06.048555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4af983b8-c3f6-407c-8ffe-92e6a555b58a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:06.048699 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e242ed6-e51f-42c8-aaa8-1d680cafdc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:06.048988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4af983b8-c3f6-407c-8ffe-92e6a555b58a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:06.049153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e242ed6-e51f-42c8-aaa8-1d680cafdc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:06.186201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4af983b8-c3f6-407c-8ffe-92e6a555b58a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:06.189425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1e242ed6-e51f-42c8-aaa8-1d680cafdc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:06.194186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4af983b8-c3f6-407c-8ffe-92e6a555b58a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159647 Feb 21 01:06:06.194752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 852/1521] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:06 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:06.197361 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1e242ed6-e51f-42c8-aaa8-1d680cafdc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163007 Feb 21 01:06:06.198079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 670/1522] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:06 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:06.199294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:06.199890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:06.205539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:06.205976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:06.206737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:06.207157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:06.267964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:06.277230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:06.279689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:06.281250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2e0aa2af-fbf1-4bd6-9e0f-d1bd9368cae1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085463 Feb 21 01:06:06.282025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 853/1523] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:06 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:07.215272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8b694297-ff79-4b1c-8baa-d29cef525aca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:07.216289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8b694297-ff79-4b1c-8baa-d29cef525aca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:07.217636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-28e57af0-212a-4f89-aa70-a50b92b83a0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:07.218597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-28e57af0-212a-4f89-aa70-a50b92b83a0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:07.226432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b694297-ff79-4b1c-8baa-d29cef525aca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:07.227169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b694297-ff79-4b1c-8baa-d29cef525aca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:07.228493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b694297-ff79-4b1c-8baa-d29cef525aca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:07.228756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-28e57af0-212a-4f89-aa70-a50b92b83a0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:07.229311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-28e57af0-212a-4f89-aa70-a50b92b83a0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:07.229584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8b694297-ff79-4b1c-8baa-d29cef525aca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:07.230557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-28e57af0-212a-4f89-aa70-a50b92b83a0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:07.231300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-28e57af0-212a-4f89-aa70-a50b92b83a0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:07.374219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-28e57af0-212a-4f89-aa70-a50b92b83a0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:07.375168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8b694297-ff79-4b1c-8baa-d29cef525aca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:07.382247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-28e57af0-212a-4f89-aa70-a50b92b83a0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.170652 Feb 21 01:06:07.391749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 854/1524] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:07 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:07.391943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8b694297-ff79-4b1c-8baa-d29cef525aca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.174178 Feb 21 01:06:07.391943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 671/1525] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:07 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:07.392149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:07.392149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:07.394009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:07.394462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:07.395280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:07.395713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:07.456691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:07.464862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:07.466378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:07.467461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7b4ba127-beef-4c99-ae1c-6c6aa7e2ac0b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083761 Feb 21 01:06:07.468030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 855/1526] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:07 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:08.403682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a274745f-435b-4695-9a30-80d9f63ca41f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:08.404584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5672c41c-e152-418b-be41-ab8b0caff1c6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:08.405242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5672c41c-e152-418b-be41-ab8b0caff1c6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:08.405431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a274745f-435b-4695-9a30-80d9f63ca41f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:08.414828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a274745f-435b-4695-9a30-80d9f63ca41f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:08.415082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5672c41c-e152-418b-be41-ab8b0caff1c6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:08.415602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a274745f-435b-4695-9a30-80d9f63ca41f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:08.415905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5672c41c-e152-418b-be41-ab8b0caff1c6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:08.417022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a274745f-435b-4695-9a30-80d9f63ca41f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:08.417161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5672c41c-e152-418b-be41-ab8b0caff1c6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:08.417453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a274745f-435b-4695-9a30-80d9f63ca41f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:08.417591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5672c41c-e152-418b-be41-ab8b0caff1c6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:08.553343 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a274745f-435b-4695-9a30-80d9f63ca41f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:08.555348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5672c41c-e152-418b-be41-ab8b0caff1c6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:08.561659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a274745f-435b-4695-9a30-80d9f63ca41f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.164663 Feb 21 01:06:08.562232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 672/1527] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:08 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:08.563309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5672c41c-e152-418b-be41-ab8b0caff1c6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166217 Feb 21 01:06:08.564039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 856/1528] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:08 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:08.566803 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:08.567402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:08.573239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:08.573676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:08.574442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:08.574863 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:08.633332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:08.641531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:08.643007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:08.644158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-330d2ec6-cf64-4168-a65e-0139315602be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.081041 Feb 21 01:06:08.644748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 673/1529] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:09.579728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-526ea609-4932-4952-bdce-6e96b9160543 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:09.580423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-526ea609-4932-4952-bdce-6e96b9160543 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:09.580708 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9dfee90f-5284-463e-b4c3-df3e783cb4ad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:09.581423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9dfee90f-5284-463e-b4c3-df3e783cb4ad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:09.588428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-526ea609-4932-4952-bdce-6e96b9160543 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:09.588961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-526ea609-4932-4952-bdce-6e96b9160543 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:09.589129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9dfee90f-5284-463e-b4c3-df3e783cb4ad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:09.589652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9dfee90f-5284-463e-b4c3-df3e783cb4ad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:09.589823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-526ea609-4932-4952-bdce-6e96b9160543 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:09.590364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-526ea609-4932-4952-bdce-6e96b9160543 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:09.590558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9dfee90f-5284-463e-b4c3-df3e783cb4ad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:09.591030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9dfee90f-5284-463e-b4c3-df3e783cb4ad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:09.725220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-526ea609-4932-4952-bdce-6e96b9160543 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:09.729585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9dfee90f-5284-463e-b4c3-df3e783cb4ad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:09.733139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-526ea609-4932-4952-bdce-6e96b9160543 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.157767 Feb 21 01:06:09.733759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 857/1530] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:09 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:09.737810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9dfee90f-5284-463e-b4c3-df3e783cb4ad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.161377 Feb 21 01:06:09.738041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:09.738753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 674/1531] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:09 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:09.744636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:09.750650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:09.751096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:09.751881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:09.752299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:09.810810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:09.819498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:09.821018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:09.822165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d80eddab-f278-44f4-971e-c334057cccf5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087474 Feb 21 01:06:09.822767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 858/1532] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:10.751769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-893de903-2467-4e2f-9b29-3ce5f730b07a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:10.752416 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-893de903-2467-4e2f-9b29-3ce5f730b07a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:10.754872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-172f916b-791f-46e3-9746-0d1036876185 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:10.755544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-172f916b-791f-46e3-9746-0d1036876185 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:10.759544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-893de903-2467-4e2f-9b29-3ce5f730b07a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:10.760012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-893de903-2467-4e2f-9b29-3ce5f730b07a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:10.760867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-893de903-2467-4e2f-9b29-3ce5f730b07a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:10.761318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-893de903-2467-4e2f-9b29-3ce5f730b07a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:10.762612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-172f916b-791f-46e3-9746-0d1036876185 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:10.763078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-172f916b-791f-46e3-9746-0d1036876185 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:10.763904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-172f916b-791f-46e3-9746-0d1036876185 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:10.764350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-172f916b-791f-46e3-9746-0d1036876185 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:10.895996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-893de903-2467-4e2f-9b29-3ce5f730b07a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:10.905355 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-172f916b-791f-46e3-9746-0d1036876185 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:10.905515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-893de903-2467-4e2f-9b29-3ce5f730b07a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.157675 Feb 21 01:06:10.906086 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 675/1533] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:10 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:10.910586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:10.911346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:10.913617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-172f916b-791f-46e3-9746-0d1036876185 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162666 Feb 21 01:06:10.917354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:10.917853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:10.918665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:10.919086 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:10.923073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 859/1534] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:10 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:10.978729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:10.987165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:10.988697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:10.989825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-15806762-7595-413b-a691-f7c499bf047f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.082786 Feb 21 01:06:10.990373 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 676/1535] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:10 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:11.926473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7c36993e-e571-47ae-9315-b78f715c031a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:11.927714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7c36993e-e571-47ae-9315-b78f715c031a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:11.934163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c85f9680-e7ee-40e3-922e-658b14bf4612 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:11.935179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c85f9680-e7ee-40e3-922e-658b14bf4612 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:11.938396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c36993e-e571-47ae-9315-b78f715c031a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:11.939130 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c36993e-e571-47ae-9315-b78f715c031a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:11.940383 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c36993e-e571-47ae-9315-b78f715c031a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:11.941163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c36993e-e571-47ae-9315-b78f715c031a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:11.945571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c85f9680-e7ee-40e3-922e-658b14bf4612 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:11.946303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c85f9680-e7ee-40e3-922e-658b14bf4612 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:11.947573 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c85f9680-e7ee-40e3-922e-658b14bf4612 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:11.948282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c85f9680-e7ee-40e3-922e-658b14bf4612 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:12.078203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7c36993e-e571-47ae-9315-b78f715c031a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:12.087818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7c36993e-e571-47ae-9315-b78f715c031a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.166260 Feb 21 01:06:12.087818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 860/1536] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:11 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:12.088294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c85f9680-e7ee-40e3-922e-658b14bf4612 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:12.093386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:12.094127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:12.096858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c85f9680-e7ee-40e3-922e-658b14bf4612 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168663 Feb 21 01:06:12.097619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 677/1537] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:11 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:12.099927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:12.100361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:12.101185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:12.101607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:12.174034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:12.186601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:12.188059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:12.189239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-902f69fc-a279-4f21-b1cf-582fcb0402ec tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101424 Feb 21 01:06:12.190012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 861/1538] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:13.104917 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-31fe1670-28c1-4dea-b4ea-2c6a9a27a744 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:13.105544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-31fe1670-28c1-4dea-b4ea-2c6a9a27a744 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:13.112575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31fe1670-28c1-4dea-b4ea-2c6a9a27a744 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:13.112998 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31fe1670-28c1-4dea-b4ea-2c6a9a27a744 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:13.113859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31fe1670-28c1-4dea-b4ea-2c6a9a27a744 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:13.114063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8e70db5c-49c7-49d1-977c-a82fedff7536 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:13.114530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31fe1670-28c1-4dea-b4ea-2c6a9a27a744 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:13.114878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8e70db5c-49c7-49d1-977c-a82fedff7536 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:13.121546 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e70db5c-49c7-49d1-977c-a82fedff7536 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:13.121986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e70db5c-49c7-49d1-977c-a82fedff7536 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:13.122769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e70db5c-49c7-49d1-977c-a82fedff7536 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:13.123325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e70db5c-49c7-49d1-977c-a82fedff7536 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:13.253442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31fe1670-28c1-4dea-b4ea-2c6a9a27a744 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:13.262343 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-31fe1670-28c1-4dea-b4ea-2c6a9a27a744 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.161163 Feb 21 01:06:13.263344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 678/1539] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:13 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:13.268915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:13.269493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:13.273334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8e70db5c-49c7-49d1-977c-a82fedff7536 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:13.280237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:13.280685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:13.281510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:13.281739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8e70db5c-49c7-49d1-977c-a82fedff7536 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171467 Feb 21 01:06:13.281909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:13.282314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 862/1540] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:13 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:13.341912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:13.350650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:13.352162 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:13.353325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-919d8d5b-a153-4e41-9a23-928247da73e0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089090 Feb 21 01:06:13.353888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 679/1541] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:14.284469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-43645d0c-6b70-444d-9220-597adbe5074b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:14.285655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-43645d0c-6b70-444d-9220-597adbe5074b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:14.296234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43645d0c-6b70-444d-9220-597adbe5074b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:14.296711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43645d0c-6b70-444d-9220-597adbe5074b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:14.297495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43645d0c-6b70-444d-9220-597adbe5074b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:14.297922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43645d0c-6b70-444d-9220-597adbe5074b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:14.299720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0d375804-1c2d-4871-8fb3-de59b9340abc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:14.300370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0d375804-1c2d-4871-8fb3-de59b9340abc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:14.306942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d375804-1c2d-4871-8fb3-de59b9340abc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:14.307382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d375804-1c2d-4871-8fb3-de59b9340abc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:14.308154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d375804-1c2d-4871-8fb3-de59b9340abc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:14.308589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d375804-1c2d-4871-8fb3-de59b9340abc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:14.433699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-43645d0c-6b70-444d-9220-597adbe5074b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:14.441779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-43645d0c-6b70-444d-9220-597adbe5074b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163920 Feb 21 01:06:14.442361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 863/1542] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:14 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:14.446050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0d375804-1c2d-4871-8fb3-de59b9340abc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:14.450379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:14.450981 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:14.453951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0d375804-1c2d-4871-8fb3-de59b9340abc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157923 Feb 21 01:06:14.454568 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 680/1543] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:14 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:14.456980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:14.457415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:14.458182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:14.458601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:14.517681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:14.526763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:14.528116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:14.529340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-51a261e5-eb2e-4882-b4d9-cae0cb738a9f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085952 Feb 21 01:06:14.529885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 864/1544] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:15.459917 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-037e7c18-691f-4bb5-b409-a6437ba5c81a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:15.460631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-037e7c18-691f-4bb5-b409-a6437ba5c81a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:15.468303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-037e7c18-691f-4bb5-b409-a6437ba5c81a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:15.468783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-037e7c18-691f-4bb5-b409-a6437ba5c81a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:15.469563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-037e7c18-691f-4bb5-b409-a6437ba5c81a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:15.469993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-037e7c18-691f-4bb5-b409-a6437ba5c81a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:15.470637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-849127a0-4049-4328-b6ed-5c63f33f75c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:15.471240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-849127a0-4049-4328-b6ed-5c63f33f75c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:15.477926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-849127a0-4049-4328-b6ed-5c63f33f75c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:15.478363 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-849127a0-4049-4328-b6ed-5c63f33f75c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:15.479134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-849127a0-4049-4328-b6ed-5c63f33f75c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:15.479552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-849127a0-4049-4328-b6ed-5c63f33f75c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:15.602205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-037e7c18-691f-4bb5-b409-a6437ba5c81a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:15.610028 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-037e7c18-691f-4bb5-b409-a6437ba5c81a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.154334 Feb 21 01:06:15.610599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 681/1545] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:15 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:15.613883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-849127a0-4049-4328-b6ed-5c63f33f75c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:15.618378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:15.618989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:15.621638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-849127a0-4049-4328-b6ed-5c63f33f75c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.154895 Feb 21 01:06:15.622197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 865/1546] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:15 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:15.625375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:15.625888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:15.626760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:15.627254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:15.690562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:15.698869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:15.700368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:15.701531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-53d9374e-3bea-4526-9fd7-e172ef5453be tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086805 Feb 21 01:06:15.702164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 682/1547] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:16.631238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1bec5479-ed02-4c81-9aa5-730fadabf2e4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:16.632295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1bec5479-ed02-4c81-9aa5-730fadabf2e4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:16.642305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b098086e-a8bd-45e7-9900-3cc0b38daddc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:16.643128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bec5479-ed02-4c81-9aa5-730fadabf2e4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:16.643539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b098086e-a8bd-45e7-9900-3cc0b38daddc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:16.643812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bec5479-ed02-4c81-9aa5-730fadabf2e4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:16.645060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bec5479-ed02-4c81-9aa5-730fadabf2e4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:16.645765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1bec5479-ed02-4c81-9aa5-730fadabf2e4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:16.656482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b098086e-a8bd-45e7-9900-3cc0b38daddc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:16.657095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b098086e-a8bd-45e7-9900-3cc0b38daddc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:16.658523 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b098086e-a8bd-45e7-9900-3cc0b38daddc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:16.659324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b098086e-a8bd-45e7-9900-3cc0b38daddc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:16.786570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1bec5479-ed02-4c81-9aa5-730fadabf2e4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:16.794691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b098086e-a8bd-45e7-9900-3cc0b38daddc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:16.795034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1bec5479-ed02-4c81-9aa5-730fadabf2e4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.169965 Feb 21 01:06:16.795685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 866/1548] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:16 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:16.803085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b098086e-a8bd-45e7-9900-3cc0b38daddc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.167162 Feb 21 01:06:16.803808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 683/1549] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:16 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:17.183222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:17.183825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:17.190202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:17.190644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:17.191413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:17.191833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:17.254061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:17.262365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:17.263835 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:17.264972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-56fdfe62-a4ab-4adb-b990-7a70f8c34e1c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.468324 Feb 21 01:06:17.265633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 867/1550] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:17.816364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7ef67014-a388-45d6-bdba-e43fe89e92cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:17.817436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7ef67014-a388-45d6-bdba-e43fe89e92cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:17.828419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ef67014-a388-45d6-bdba-e43fe89e92cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:17.828736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ef67014-a388-45d6-bdba-e43fe89e92cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:17.829521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ef67014-a388-45d6-bdba-e43fe89e92cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:17.829959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7ef67014-a388-45d6-bdba-e43fe89e92cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:17.961352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7ef67014-a388-45d6-bdba-e43fe89e92cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:17.963344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3dd57fb9-7d68-4f48-a7d5-2f31687c2518 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:17.963953 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3dd57fb9-7d68-4f48-a7d5-2f31687c2518 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:17.969512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7ef67014-a388-45d6-bdba-e43fe89e92cc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.159400 Feb 21 01:06:17.969855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dd57fb9-7d68-4f48-a7d5-2f31687c2518 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:17.970115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 684/1551] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:17 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:06:17.970273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dd57fb9-7d68-4f48-a7d5-2f31687c2518 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:17.971081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dd57fb9-7d68-4f48-a7d5-2f31687c2518 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:17.971490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dd57fb9-7d68-4f48-a7d5-2f31687c2518 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:18.104714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3dd57fb9-7d68-4f48-a7d5-2f31687c2518 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:18.112926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3dd57fb9-7d68-4f48-a7d5-2f31687c2518 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.295120 Feb 21 01:06:18.113501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 868/1552] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:17 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:18.287111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:18.288104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:18.298413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:18.299148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:18.300470 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:18.301164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:18.371507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:18.380036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:18.381566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:18.382707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bd6d0a9b-48c3-415c-8239-35402ec791c5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102084 Feb 21 01:06:18.383272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 685/1553] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:18.990625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eb01abd0-f75b-4ab5-beb3-ffac9768bf3b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:18.991546 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eb01abd0-f75b-4ab5-beb3-ffac9768bf3b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:19.001526 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb01abd0-f75b-4ab5-beb3-ffac9768bf3b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:19.001963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb01abd0-f75b-4ab5-beb3-ffac9768bf3b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:19.002728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb01abd0-f75b-4ab5-beb3-ffac9768bf3b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:19.003147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb01abd0-f75b-4ab5-beb3-ffac9768bf3b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:19.134169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5d9f0200-6ea8-4157-8eec-35ed44b45112 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:19.134749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5d9f0200-6ea8-4157-8eec-35ed44b45112 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:19.140610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eb01abd0-f75b-4ab5-beb3-ffac9768bf3b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:19.141644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5d9f0200-6ea8-4157-8eec-35ed44b45112 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:19.142124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5d9f0200-6ea8-4157-8eec-35ed44b45112 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:19.142918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5d9f0200-6ea8-4157-8eec-35ed44b45112 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:19.143351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5d9f0200-6ea8-4157-8eec-35ed44b45112 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:19.149597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eb01abd0-f75b-4ab5-beb3-ffac9768bf3b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.165199 Feb 21 01:06:19.150156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 869/1554] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:18 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:19.294844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5d9f0200-6ea8-4157-8eec-35ed44b45112 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:19.304062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5d9f0200-6ea8-4157-8eec-35ed44b45112 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173635 Feb 21 01:06:19.304700 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 686/1555] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:19 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:19.406438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:19.407541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:19.419937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:19.420769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:19.422054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:19.422495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:19.490197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:19.503769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:19.506267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:19.508104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6d64a126-761d-49e8-ac1a-4da807835f07 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.107657 Feb 21 01:06:19.509014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 870/1556] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:20.170400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ef732fac-f68c-49f0-bd17-71e8e2219cd2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:20.171394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ef732fac-f68c-49f0-bd17-71e8e2219cd2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:20.178399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef732fac-f68c-49f0-bd17-71e8e2219cd2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:20.178842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef732fac-f68c-49f0-bd17-71e8e2219cd2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:20.179605 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef732fac-f68c-49f0-bd17-71e8e2219cd2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:20.180099 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ef732fac-f68c-49f0-bd17-71e8e2219cd2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:20.314505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ef732fac-f68c-49f0-bd17-71e8e2219cd2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:20.321327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1cdc79d1-e7cf-420d-a23c-01c643263966 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:20.321905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1cdc79d1-e7cf-420d-a23c-01c643263966 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:20.322810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ef732fac-f68c-49f0-bd17-71e8e2219cd2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.158519 Feb 21 01:06:20.323584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 687/1557] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:20 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:20.328760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1cdc79d1-e7cf-420d-a23c-01c643263966 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:20.329213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1cdc79d1-e7cf-420d-a23c-01c643263966 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:20.329951 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1cdc79d1-e7cf-420d-a23c-01c643263966 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:20.330379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1cdc79d1-e7cf-420d-a23c-01c643263966 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:20.469451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1cdc79d1-e7cf-420d-a23c-01c643263966 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:20.477791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1cdc79d1-e7cf-420d-a23c-01c643263966 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160144 Feb 21 01:06:20.478369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 871/1558] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:20 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:20.530039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:20.530657 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:20.537307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:20.537768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:20.538545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:20.538959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:20.602812 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:20.611141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:20.612670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:20.613820 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-727234c3-44a9-422d-ad57-76c8a9f3fe3d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088306 Feb 21 01:06:20.614349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 688/1559] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:21.343814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b27b2886-566d-4f5a-b850-2f6380127b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:21.344477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b27b2886-566d-4f5a-b850-2f6380127b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:21.351636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b27b2886-566d-4f5a-b850-2f6380127b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:21.352103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b27b2886-566d-4f5a-b850-2f6380127b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:21.352966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b27b2886-566d-4f5a-b850-2f6380127b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:21.353415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b27b2886-566d-4f5a-b850-2f6380127b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:21.495685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b27b2886-566d-4f5a-b850-2f6380127b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:21.496905 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a1157a8c-012c-4be3-be6b-16ab2b7b64fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:21.497885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a1157a8c-012c-4be3-be6b-16ab2b7b64fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:21.508118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1157a8c-012c-4be3-be6b-16ab2b7b64fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:21.508495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b27b2886-566d-4f5a-b850-2f6380127b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.170637 Feb 21 01:06:21.508814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1157a8c-012c-4be3-be6b-16ab2b7b64fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:21.509318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 872/1560] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:21 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:21.509881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1157a8c-012c-4be3-be6b-16ab2b7b64fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:21.510496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1157a8c-012c-4be3-be6b-16ab2b7b64fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:21.631162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:21.631768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:21.637912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:21.638352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:21.639126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:21.639554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:21.651864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a1157a8c-012c-4be3-be6b-16ab2b7b64fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:21.660207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a1157a8c-012c-4be3-be6b-16ab2b7b64fc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169219 Feb 21 01:06:21.660819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 689/1561] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:21 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:06:21.704438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:21.713247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:21.714763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:21.715903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-335faa58-287e-40ee-bb9f-9e95bf575dc4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088619 Feb 21 01:06:21.716476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 873/1562] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:22.528945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bdebb354-154f-4922-9517-2d3d932e3de5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:22.529576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bdebb354-154f-4922-9517-2d3d932e3de5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:22.537161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bdebb354-154f-4922-9517-2d3d932e3de5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:22.537612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bdebb354-154f-4922-9517-2d3d932e3de5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:22.538401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bdebb354-154f-4922-9517-2d3d932e3de5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:22.538825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bdebb354-154f-4922-9517-2d3d932e3de5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:22.676026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bdebb354-154f-4922-9517-2d3d932e3de5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:22.677021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-27e443ce-107e-4231-9cb8-c3a282a177cb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:22.677637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-27e443ce-107e-4231-9cb8-c3a282a177cb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:22.683906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27e443ce-107e-4231-9cb8-c3a282a177cb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:22.684433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27e443ce-107e-4231-9cb8-c3a282a177cb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:22.685247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27e443ce-107e-4231-9cb8-c3a282a177cb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:22.685707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-27e443ce-107e-4231-9cb8-c3a282a177cb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:22.685834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bdebb354-154f-4922-9517-2d3d932e3de5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.160599 Feb 21 01:06:22.686482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 690/1563] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:22 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:22.735679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:22.736446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:22.746111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:22.746655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:22.748020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:22.748775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:22.812580 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:22.820988 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:22.822763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:22.823946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-43c72927-df19-45ca-83a5-56ed66dae842 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094044 Feb 21 01:06:22.824575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 691/1564] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:22.830249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-27e443ce-107e-4231-9cb8-c3a282a177cb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:22.838841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-27e443ce-107e-4231-9cb8-c3a282a177cb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165614 Feb 21 01:06:22.839966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 874/1565] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:22 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:23.703599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-84af1b36-13a0-4d0d-bca9-e9959147b83e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:23.704215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-84af1b36-13a0-4d0d-bca9-e9959147b83e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:23.710956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84af1b36-13a0-4d0d-bca9-e9959147b83e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:23.711401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84af1b36-13a0-4d0d-bca9-e9959147b83e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:23.712165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84af1b36-13a0-4d0d-bca9-e9959147b83e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:23.712626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84af1b36-13a0-4d0d-bca9-e9959147b83e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:23.842619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:23.843387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:23.850259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:23.850763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:23.851643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:23.852145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:23.857570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-84af1b36-13a0-4d0d-bca9-e9959147b83e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:23.866070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-84af1b36-13a0-4d0d-bca9-e9959147b83e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.166483 Feb 21 01:06:23.866648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 692/1566] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:23 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:23.870949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-82e8f198-773d-441b-834e-15141734f9c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:23.871694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-82e8f198-773d-441b-834e-15141734f9c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:23.877702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-82e8f198-773d-441b-834e-15141734f9c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:23.878145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-82e8f198-773d-441b-834e-15141734f9c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:23.878925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-82e8f198-773d-441b-834e-15141734f9c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:23.879350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-82e8f198-773d-441b-834e-15141734f9c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:23.914062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:23.922814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:23.924275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:23.925456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a55d25ab-d2c3-46ef-84c3-41c99471b9ff tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086774 Feb 21 01:06:23.926038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 875/1567] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:24.011767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-82e8f198-773d-441b-834e-15141734f9c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:24.020247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-82e8f198-773d-441b-834e-15141734f9c0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.152654 Feb 21 01:06:24.020834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 693/1568] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:23 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:24.883329 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7b5a68e4-19d2-4dcb-9d42-3145ca48343b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:24.883926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7b5a68e4-19d2-4dcb-9d42-3145ca48343b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:24.890862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b5a68e4-19d2-4dcb-9d42-3145ca48343b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:24.891330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b5a68e4-19d2-4dcb-9d42-3145ca48343b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:24.892117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b5a68e4-19d2-4dcb-9d42-3145ca48343b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:24.892580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b5a68e4-19d2-4dcb-9d42-3145ca48343b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:24.943443 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:24.944145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:24.950969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:24.951421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:24.952202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:24.952660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:25.018019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:25.026720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:25.028189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:25.029363 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6b634a82-c7c8-4381-a309-2d9c531ae2b5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089952 Feb 21 01:06:25.029928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 694/1569] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:25.034005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7b5a68e4-19d2-4dcb-9d42-3145ca48343b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:25.037087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-54ac7767-b74f-481e-bccb-c134a3948c9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:25.037686 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-54ac7767-b74f-481e-bccb-c134a3948c9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:25.042763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7b5a68e4-19d2-4dcb-9d42-3145ca48343b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163311 Feb 21 01:06:25.043394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 876/1570] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:24 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:25.043540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54ac7767-b74f-481e-bccb-c134a3948c9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:25.043947 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54ac7767-b74f-481e-bccb-c134a3948c9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:25.044760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54ac7767-b74f-481e-bccb-c134a3948c9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:25.045284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54ac7767-b74f-481e-bccb-c134a3948c9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:25.184886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-54ac7767-b74f-481e-bccb-c134a3948c9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:25.194279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-54ac7767-b74f-481e-bccb-c134a3948c9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160612 Feb 21 01:06:25.194845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 695/1571] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:25 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:06:26.051317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:26.052273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:26.062629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ffe752ee-1740-4dbc-bfcb-b841cc5ad97f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:26.063646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ffe752ee-1740-4dbc-bfcb-b841cc5ad97f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:26.063916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:26.064711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:26.065983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:26.066687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:26.074504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ffe752ee-1740-4dbc-bfcb-b841cc5ad97f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:26.075270 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ffe752ee-1740-4dbc-bfcb-b841cc5ad97f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:26.076612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ffe752ee-1740-4dbc-bfcb-b841cc5ad97f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:26.077355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ffe752ee-1740-4dbc-bfcb-b841cc5ad97f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:26.131964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:26.140482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:26.142069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:26.143155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1278758c-fa49-4ab9-898b-a4e88b62e3d6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098269 Feb 21 01:06:26.143831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 877/1572] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:26.211620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ffe752ee-1740-4dbc-bfcb-b841cc5ad97f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:26.213505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e521cdbf-5347-4163-ab50-fac270311bab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:26.214264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e521cdbf-5347-4163-ab50-fac270311bab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:26.221172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e521cdbf-5347-4163-ab50-fac270311bab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:26.221356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ffe752ee-1740-4dbc-bfcb-b841cc5ad97f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.164671 Feb 21 01:06:26.221617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e521cdbf-5347-4163-ab50-fac270311bab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:26.221776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 696/1573] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:26 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:26.222403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e521cdbf-5347-4163-ab50-fac270311bab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:26.222934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e521cdbf-5347-4163-ab50-fac270311bab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:26.368550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e521cdbf-5347-4163-ab50-fac270311bab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:26.376814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e521cdbf-5347-4163-ab50-fac270311bab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168974 Feb 21 01:06:26.377390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 878/1574] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:26 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:27.163992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:27.164906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:27.174083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:27.174716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:27.175817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:27.176451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:27.238397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cbee00c7-2aaf-47de-84b6-a66b89dd20d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:27.239053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cbee00c7-2aaf-47de-84b6-a66b89dd20d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:27.243799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:27.246076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbee00c7-2aaf-47de-84b6-a66b89dd20d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:27.246591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbee00c7-2aaf-47de-84b6-a66b89dd20d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:27.247452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbee00c7-2aaf-47de-84b6-a66b89dd20d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:27.247924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cbee00c7-2aaf-47de-84b6-a66b89dd20d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:27.252695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:27.254190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:27.255321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-507518fd-36fe-44cd-8d51-b2371d94b03f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096743 Feb 21 01:06:27.255886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 697/1575] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:27.388018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cbee00c7-2aaf-47de-84b6-a66b89dd20d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:27.393169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6f1ef034-daae-4ec0-a03a-81bdca813827 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:27.394173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6f1ef034-daae-4ec0-a03a-81bdca813827 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:27.397095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cbee00c7-2aaf-47de-84b6-a66b89dd20d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.162443 Feb 21 01:06:27.397747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 879/1576] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:27 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:27.401186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f1ef034-daae-4ec0-a03a-81bdca813827 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:27.401664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f1ef034-daae-4ec0-a03a-81bdca813827 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:27.402448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f1ef034-daae-4ec0-a03a-81bdca813827 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:27.402870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6f1ef034-daae-4ec0-a03a-81bdca813827 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:27.544643 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6f1ef034-daae-4ec0-a03a-81bdca813827 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:27.553085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6f1ef034-daae-4ec0-a03a-81bdca813827 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163790 Feb 21 01:06:27.553668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 698/1577] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:27 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:06:28.276720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:28.277729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:28.287929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:28.288748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:28.290041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:28.290766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:28.361847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:28.370549 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:28.372039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:28.373220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c2e71d2e-7853-4ae6-be22-160c8a668921 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103244 Feb 21 01:06:28.373789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 880/1578] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:28.418208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6021e0af-0045-406b-91f0-69200ea7e10c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:28.420078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6021e0af-0045-406b-91f0-69200ea7e10c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:28.427543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6021e0af-0045-406b-91f0-69200ea7e10c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:28.427985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6021e0af-0045-406b-91f0-69200ea7e10c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:28.428808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6021e0af-0045-406b-91f0-69200ea7e10c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:28.429225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6021e0af-0045-406b-91f0-69200ea7e10c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:28.569873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6021e0af-0045-406b-91f0-69200ea7e10c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:28.570635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-038342f4-cda6-4d73-a8d7-9355c1b4e78c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:28.571434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-038342f4-cda6-4d73-a8d7-9355c1b4e78c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:28.578049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-038342f4-cda6-4d73-a8d7-9355c1b4e78c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:28.578547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6021e0af-0045-406b-91f0-69200ea7e10c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.166125 Feb 21 01:06:28.578709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-038342f4-cda6-4d73-a8d7-9355c1b4e78c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:28.579167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 699/1579] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:28 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:28.579501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-038342f4-cda6-4d73-a8d7-9355c1b4e78c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:28.579945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-038342f4-cda6-4d73-a8d7-9355c1b4e78c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:28.725389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-038342f4-cda6-4d73-a8d7-9355c1b4e78c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:28.733449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-038342f4-cda6-4d73-a8d7-9355c1b4e78c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166913 Feb 21 01:06:28.734052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 881/1580] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:28 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:06:29.395130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:29.396171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:29.406589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:29.407329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:29.408673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:29.409407 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:29.474965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:29.483732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:29.485294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:29.486485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bf4d2edf-7656-466d-9554-df9e54916fe7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097685 Feb 21 01:06:29.487051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 700/1581] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:29.599896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bd120eba-9d66-4795-bd4f-efe4e0d1f552 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:29.600931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bd120eba-9d66-4795-bd4f-efe4e0d1f552 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:29.611610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd120eba-9d66-4795-bd4f-efe4e0d1f552 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:29.612346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd120eba-9d66-4795-bd4f-efe4e0d1f552 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:29.613659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd120eba-9d66-4795-bd4f-efe4e0d1f552 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:29.614484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bd120eba-9d66-4795-bd4f-efe4e0d1f552 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:29.750743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bfb3689f-32bf-4c21-a57a-969fa970e999 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:29.751344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bfb3689f-32bf-4c21-a57a-969fa970e999 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:29.754512 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bd120eba-9d66-4795-bd4f-efe4e0d1f552 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:29.757459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfb3689f-32bf-4c21-a57a-969fa970e999 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:29.757903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfb3689f-32bf-4c21-a57a-969fa970e999 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:29.758679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfb3689f-32bf-4c21-a57a-969fa970e999 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:29.759111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfb3689f-32bf-4c21-a57a-969fa970e999 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:29.762690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bd120eba-9d66-4795-bd4f-efe4e0d1f552 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.169116 Feb 21 01:06:29.763295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 882/1582] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:29 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:29.894702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bfb3689f-32bf-4c21-a57a-969fa970e999 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:29.903515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bfb3689f-32bf-4c21-a57a-969fa970e999 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156505 Feb 21 01:06:29.904102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 701/1583] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:29 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:30.508794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:30.509780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:30.519983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:30.520812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:30.522107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:30.522533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:30.587405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:30.596095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:30.597625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:30.598775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a0db2aac-48c3-4b20-b69b-6c34b74f10fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096240 Feb 21 01:06:30.599347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 883/1584] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:30.784483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7342aa2e-2835-44f6-aad2-8632a42dad1e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:30.785123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7342aa2e-2835-44f6-aad2-8632a42dad1e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:30.792259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7342aa2e-2835-44f6-aad2-8632a42dad1e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:30.792735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7342aa2e-2835-44f6-aad2-8632a42dad1e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:30.793517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7342aa2e-2835-44f6-aad2-8632a42dad1e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:30.793944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7342aa2e-2835-44f6-aad2-8632a42dad1e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:30.920224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-437abcd1-3b4c-4b20-9c38-f1237cbda997 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:30.921311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-437abcd1-3b4c-4b20-9c38-f1237cbda997 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:30.931542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-437abcd1-3b4c-4b20-9c38-f1237cbda997 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:30.932318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-437abcd1-3b4c-4b20-9c38-f1237cbda997 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:30.933636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-437abcd1-3b4c-4b20-9c38-f1237cbda997 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:30.934192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-437abcd1-3b4c-4b20-9c38-f1237cbda997 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:30.935278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7342aa2e-2835-44f6-aad2-8632a42dad1e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:30.943957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7342aa2e-2835-44f6-aad2-8632a42dad1e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.165940 Feb 21 01:06:30.944602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 702/1585] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:30 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:31.074462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-437abcd1-3b4c-4b20-9c38-f1237cbda997 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:31.082575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-437abcd1-3b4c-4b20-9c38-f1237cbda997 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166154 Feb 21 01:06:31.083172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 884/1586] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:30 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:31.620658 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:31.621677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:31.632240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:31.632688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:31.633617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:31.634051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:31.700975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:31.713990 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:31.716280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:31.718118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4163cf7c-8beb-4bdd-9486-7a307a745878 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103536 Feb 21 01:06:31.718918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 703/1587] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:31.965330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d200e5df-0bb7-4d20-9fe1-64ff49fb21a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:31.966316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d200e5df-0bb7-4d20-9fe1-64ff49fb21a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:31.976550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d200e5df-0bb7-4d20-9fe1-64ff49fb21a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:31.977284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d200e5df-0bb7-4d20-9fe1-64ff49fb21a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:31.978545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d200e5df-0bb7-4d20-9fe1-64ff49fb21a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:31.979213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d200e5df-0bb7-4d20-9fe1-64ff49fb21a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:32.105074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6a6dce53-f98e-4d3b-939b-f66a0d656550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:32.105761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6a6dce53-f98e-4d3b-939b-f66a0d656550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:32.112704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a6dce53-f98e-4d3b-939b-f66a0d656550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:32.113244 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a6dce53-f98e-4d3b-939b-f66a0d656550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:32.114035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a6dce53-f98e-4d3b-939b-f66a0d656550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:32.114476 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a6dce53-f98e-4d3b-939b-f66a0d656550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:32.134187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d200e5df-0bb7-4d20-9fe1-64ff49fb21a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:32.142267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d200e5df-0bb7-4d20-9fe1-64ff49fb21a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.183366 Feb 21 01:06:32.142866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 885/1588] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:31 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:32.253444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6a6dce53-f98e-4d3b-939b-f66a0d656550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:32.262260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6a6dce53-f98e-4d3b-939b-f66a0d656550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160886 Feb 21 01:06:32.262833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 704/1589] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:32 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:06:32.740735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:32.741468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:32.749177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:32.749705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:32.750619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:32.751119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:32.813838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:32.822261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:32.823788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:32.824977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-18f2d371-c741-47dd-b556-6c02a4e91d06 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090783 Feb 21 01:06:32.825536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 886/1590] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:33.163655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-542a12fb-c59d-4737-9f96-2ed44f09f684 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:33.164330 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-542a12fb-c59d-4737-9f96-2ed44f09f684 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:33.172720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-542a12fb-c59d-4737-9f96-2ed44f09f684 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:33.173280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-542a12fb-c59d-4737-9f96-2ed44f09f684 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:33.174246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-542a12fb-c59d-4737-9f96-2ed44f09f684 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:33.174792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-542a12fb-c59d-4737-9f96-2ed44f09f684 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:33.286861 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6ebe6fea-54ba-4150-ad26-6df9346446b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:33.287559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6ebe6fea-54ba-4150-ad26-6df9346446b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:33.294121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ebe6fea-54ba-4150-ad26-6df9346446b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:33.294558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ebe6fea-54ba-4150-ad26-6df9346446b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:33.295334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ebe6fea-54ba-4150-ad26-6df9346446b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:33.295755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6ebe6fea-54ba-4150-ad26-6df9346446b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:33.317898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-542a12fb-c59d-4737-9f96-2ed44f09f684 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:33.326138 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-542a12fb-c59d-4737-9f96-2ed44f09f684 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.168630 Feb 21 01:06:33.326907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 705/1591] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:33 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:33.432611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6ebe6fea-54ba-4150-ad26-6df9346446b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:33.444208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6ebe6fea-54ba-4150-ad26-6df9346446b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160855 Feb 21 01:06:33.445003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 887/1592] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:33 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:33.847095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:33.848097 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:33.855383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:33.855836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:33.856668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:33.857094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:33.921449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:33.929967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:33.931469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:33.932650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3e9f01d5-5c63-4edd-b800-11ec8faf2dcf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092000 Feb 21 01:06:33.933216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 706/1593] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:34.347249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4a4b5ee3-a1db-4dc6-bc7d-64678165544c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:34.348209 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4a4b5ee3-a1db-4dc6-bc7d-64678165544c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:34.358852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a4b5ee3-a1db-4dc6-bc7d-64678165544c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:34.359579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a4b5ee3-a1db-4dc6-bc7d-64678165544c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:34.360906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a4b5ee3-a1db-4dc6-bc7d-64678165544c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:34.361612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a4b5ee3-a1db-4dc6-bc7d-64678165544c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:34.462898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-021e1869-1485-434e-a021-b991f5b5be53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:34.463504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-021e1869-1485-434e-a021-b991f5b5be53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:34.470272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-021e1869-1485-434e-a021-b991f5b5be53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:34.470714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-021e1869-1485-434e-a021-b991f5b5be53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:34.471501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-021e1869-1485-434e-a021-b991f5b5be53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:34.471919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-021e1869-1485-434e-a021-b991f5b5be53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:34.502360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4a4b5ee3-a1db-4dc6-bc7d-64678165544c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:34.510366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4a4b5ee3-a1db-4dc6-bc7d-64678165544c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.169313 Feb 21 01:06:34.511202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 888/1594] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:34 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:34.603886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-021e1869-1485-434e-a021-b991f5b5be53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:34.612613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-021e1869-1485-434e-a021-b991f5b5be53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.153301 Feb 21 01:06:34.613200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 707/1595] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:34 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:34.954294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:34.955161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:34.963259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:34.963704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:34.964516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:34.964943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:35.033103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:35.041743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:35.043231 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:35.044422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-99ba2ff5-f36e-4920-b92d-4434b2e75dd6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096538 Feb 21 01:06:35.044990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 889/1596] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:35.530150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cd669970-52b1-489f-8886-5109ab11ac4c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:35.530990 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cd669970-52b1-489f-8886-5109ab11ac4c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:35.539556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cd669970-52b1-489f-8886-5109ab11ac4c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:35.540163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cd669970-52b1-489f-8886-5109ab11ac4c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:35.541265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cd669970-52b1-489f-8886-5109ab11ac4c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:35.541841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cd669970-52b1-489f-8886-5109ab11ac4c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:35.629727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f2a846d6-ff57-49e3-8afa-9e3b1723dcdd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:35.630352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f2a846d6-ff57-49e3-8afa-9e3b1723dcdd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:35.636959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2a846d6-ff57-49e3-8afa-9e3b1723dcdd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:35.637396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2a846d6-ff57-49e3-8afa-9e3b1723dcdd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:35.638168 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2a846d6-ff57-49e3-8afa-9e3b1723dcdd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:35.638588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2a846d6-ff57-49e3-8afa-9e3b1723dcdd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:35.678352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cd669970-52b1-489f-8886-5109ab11ac4c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:35.686860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cd669970-52b1-489f-8886-5109ab11ac4c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.161593 Feb 21 01:06:35.687477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 708/1597] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:35 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:35.772422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f2a846d6-ff57-49e3-8afa-9e3b1723dcdd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:35.781181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f2a846d6-ff57-49e3-8afa-9e3b1723dcdd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.155131 Feb 21 01:06:35.781761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 890/1598] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:35 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:36.065649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:36.066652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:36.074198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:36.074664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:36.075468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:36.075916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:36.149122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:36.158020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:36.159500 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:36.160689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c8679fae-9022-4c6d-94ef-40dade4b6e3b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101255 Feb 21 01:06:36.161259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 709/1599] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:36 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:36.704431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-23226624-85ab-4228-bc9c-a9912de9c970 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:36.705081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-23226624-85ab-4228-bc9c-a9912de9c970 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:36.711743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23226624-85ab-4228-bc9c-a9912de9c970 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:36.712179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23226624-85ab-4228-bc9c-a9912de9c970 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:36.712980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23226624-85ab-4228-bc9c-a9912de9c970 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:36.713402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23226624-85ab-4228-bc9c-a9912de9c970 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:36.798287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1cef12df-a0cc-4e89-94c1-0a7b0a0c5de6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:36.798847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1cef12df-a0cc-4e89-94c1-0a7b0a0c5de6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:36.805721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cef12df-a0cc-4e89-94c1-0a7b0a0c5de6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:36.806169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cef12df-a0cc-4e89-94c1-0a7b0a0c5de6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:36.806945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cef12df-a0cc-4e89-94c1-0a7b0a0c5de6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:36.807369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cef12df-a0cc-4e89-94c1-0a7b0a0c5de6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:36.852928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-23226624-85ab-4228-bc9c-a9912de9c970 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:36.860788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-23226624-85ab-4228-bc9c-a9912de9c970 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.160055 Feb 21 01:06:36.861382 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 891/1600] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:36 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:36.947682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1cef12df-a0cc-4e89-94c1-0a7b0a0c5de6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:36.956219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1cef12df-a0cc-4e89-94c1-0a7b0a0c5de6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.161788 Feb 21 01:06:36.956827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 710/1601] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:36 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:37.182001 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:37.182659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:37.190453 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:37.191015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:37.191980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:37.192552 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:37.259163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:37.267750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:37.269297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:37.270476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7aa76d61-cd59-464c-95ad-3aeb90eaa65f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094300 Feb 21 01:06:37.271069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 892/1602] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:37 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:37.881804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-605d47c8-b9c9-4c42-9908-acc4679ff4cf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:37.882753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-605d47c8-b9c9-4c42-9908-acc4679ff4cf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:37.893760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-605d47c8-b9c9-4c42-9908-acc4679ff4cf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:37.894502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-605d47c8-b9c9-4c42-9908-acc4679ff4cf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:37.895944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-605d47c8-b9c9-4c42-9908-acc4679ff4cf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:37.896717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-605d47c8-b9c9-4c42-9908-acc4679ff4cf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:37.977848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-90b346c5-bfe9-4069-8ee3-dbdddab65fbe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:37.978497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-90b346c5-bfe9-4069-8ee3-dbdddab65fbe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:37.985570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90b346c5-bfe9-4069-8ee3-dbdddab65fbe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:37.986016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90b346c5-bfe9-4069-8ee3-dbdddab65fbe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:37.986799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90b346c5-bfe9-4069-8ee3-dbdddab65fbe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:37.987254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90b346c5-bfe9-4069-8ee3-dbdddab65fbe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:38.030792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-605d47c8-b9c9-4c42-9908-acc4679ff4cf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:38.039078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-605d47c8-b9c9-4c42-9908-acc4679ff4cf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163490 Feb 21 01:06:38.039625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 711/1603] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:37 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:38.118952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-90b346c5-bfe9-4069-8ee3-dbdddab65fbe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:38.127414 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-90b346c5-bfe9-4069-8ee3-dbdddab65fbe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.153440 Feb 21 01:06:38.127956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 893/1604] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:37 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:06:38.289447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:38.290067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:38.296589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:38.297039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:38.297825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:38.298251 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:38.362507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:38.371249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:38.372767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:38.373930 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e8b8e389-304e-4c10-bb42-1a48afbf6c73 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088505 Feb 21 01:06:38.374491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 712/1605] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:39.056872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5e1cb446-d928-499b-88ef-14c18a4de734 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:39.057537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5e1cb446-d928-499b-88ef-14c18a4de734 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:39.065718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e1cb446-d928-499b-88ef-14c18a4de734 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:39.066244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e1cb446-d928-499b-88ef-14c18a4de734 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:39.067140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e1cb446-d928-499b-88ef-14c18a4de734 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:39.067635 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5e1cb446-d928-499b-88ef-14c18a4de734 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:39.144540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fe2cfe31-eb24-46a9-9cc0-14270d18454c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:39.145152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fe2cfe31-eb24-46a9-9cc0-14270d18454c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:39.152024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe2cfe31-eb24-46a9-9cc0-14270d18454c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:39.152503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe2cfe31-eb24-46a9-9cc0-14270d18454c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:39.153275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe2cfe31-eb24-46a9-9cc0-14270d18454c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:39.153699 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe2cfe31-eb24-46a9-9cc0-14270d18454c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:39.208545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5e1cb446-d928-499b-88ef-14c18a4de734 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:39.216340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5e1cb446-d928-499b-88ef-14c18a4de734 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163939 Feb 21 01:06:39.216940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 894/1606] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:39 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:39.289869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fe2cfe31-eb24-46a9-9cc0-14270d18454c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:39.297824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fe2cfe31-eb24-46a9-9cc0-14270d18454c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157147 Feb 21 01:06:39.298402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 713/1607] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:39 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:39.399349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:39.399900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:39.406844 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:39.407324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:39.408208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:39.408766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:39.471455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:39.480612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:39.482093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:39.483283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fb9d41ee-a64e-4e27-b677-470dbb9082ca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091212 Feb 21 01:06:39.483859 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 895/1608] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:40.236505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3bbfdcae-4ef8-4d5c-ad6f-2abde50591a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:40.237524 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3bbfdcae-4ef8-4d5c-ad6f-2abde50591a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:40.246189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3bbfdcae-4ef8-4d5c-ad6f-2abde50591a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:40.246634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3bbfdcae-4ef8-4d5c-ad6f-2abde50591a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:40.247417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3bbfdcae-4ef8-4d5c-ad6f-2abde50591a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:40.247842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3bbfdcae-4ef8-4d5c-ad6f-2abde50591a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:40.316908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0eed5a2f-9aad-4f9f-9f78-1fab1c1789aa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:40.317500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0eed5a2f-9aad-4f9f-9f78-1fab1c1789aa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:40.323763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0eed5a2f-9aad-4f9f-9f78-1fab1c1789aa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:40.324203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0eed5a2f-9aad-4f9f-9f78-1fab1c1789aa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:40.325011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0eed5a2f-9aad-4f9f-9f78-1fab1c1789aa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:40.325456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0eed5a2f-9aad-4f9f-9f78-1fab1c1789aa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:40.380817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3bbfdcae-4ef8-4d5c-ad6f-2abde50591a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:40.388899 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3bbfdcae-4ef8-4d5c-ad6f-2abde50591a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.158657 Feb 21 01:06:40.389742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 714/1609] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:40 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:40.461096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0eed5a2f-9aad-4f9f-9f78-1fab1c1789aa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:40.469295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0eed5a2f-9aad-4f9f-9f78-1fab1c1789aa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156070 Feb 21 01:06:40.469864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 896/1610] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:40 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:40.501587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:40.502232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:40.508750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:40.509204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:40.509978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:40.510422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:40.575889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:40.589087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:40.591491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:40.593262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6d7b349c-976e-4d4d-86d8-b5dbfba8a568 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095600 Feb 21 01:06:40.594045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 715/1611] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:40 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:41.410270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5f77609c-497b-4422-bb6c-415dd9bcb1c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:41.411239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5f77609c-497b-4422-bb6c-415dd9bcb1c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:41.419576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f77609c-497b-4422-bb6c-415dd9bcb1c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:41.420019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f77609c-497b-4422-bb6c-415dd9bcb1c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:41.420834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f77609c-497b-4422-bb6c-415dd9bcb1c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:41.421262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f77609c-497b-4422-bb6c-415dd9bcb1c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:41.486492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ff3a4110-33d6-446c-9e66-c8d042644a7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:41.487077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ff3a4110-33d6-446c-9e66-c8d042644a7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:41.493815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff3a4110-33d6-446c-9e66-c8d042644a7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:41.494259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff3a4110-33d6-446c-9e66-c8d042644a7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:41.495039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff3a4110-33d6-446c-9e66-c8d042644a7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:41.495475 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff3a4110-33d6-446c-9e66-c8d042644a7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:41.563001 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5f77609c-497b-4422-bb6c-415dd9bcb1c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:41.570898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5f77609c-497b-4422-bb6c-415dd9bcb1c7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.166866 Feb 21 01:06:41.571538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 897/1612] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:41 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:41.614970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:41.616189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:41.621887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:41.622332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:41.623142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:41.623566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:41.634063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ff3a4110-33d6-446c-9e66-c8d042644a7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:41.642566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ff3a4110-33d6-446c-9e66-c8d042644a7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159849 Feb 21 01:06:41.643103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 716/1613] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:41 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:41.686471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:41.694928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:41.696473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:41.697605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dab45bd7-b9cf-4432-8278-543625efaddd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086477 Feb 21 01:06:41.698177 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 898/1614] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:41 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:06:42.587653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f65c4da8-19b1-48e4-a29d-9f084c18a415 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:42.588238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f65c4da8-19b1-48e4-a29d-9f084c18a415 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:42.595219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f65c4da8-19b1-48e4-a29d-9f084c18a415 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:42.595661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f65c4da8-19b1-48e4-a29d-9f084c18a415 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:42.596432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f65c4da8-19b1-48e4-a29d-9f084c18a415 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:42.596880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f65c4da8-19b1-48e4-a29d-9f084c18a415 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:42.661634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dde4f05a-feda-4d99-afa7-17b6ba283a87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:42.662209 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dde4f05a-feda-4d99-afa7-17b6ba283a87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:42.669184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dde4f05a-feda-4d99-afa7-17b6ba283a87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:42.669639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dde4f05a-feda-4d99-afa7-17b6ba283a87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:42.670403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dde4f05a-feda-4d99-afa7-17b6ba283a87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:42.670831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dde4f05a-feda-4d99-afa7-17b6ba283a87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:42.734266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f65c4da8-19b1-48e4-a29d-9f084c18a415 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:42.742554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f65c4da8-19b1-48e4-a29d-9f084c18a415 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.158758 Feb 21 01:06:42.743330 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 717/1615] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:42 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:42.747404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:42.748002 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:42.753756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:42.754194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:42.754973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:42.755403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:42.807592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dde4f05a-feda-4d99-afa7-17b6ba283a87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:42.815715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dde4f05a-feda-4d99-afa7-17b6ba283a87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157821 Feb 21 01:06:42.816251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 899/1616] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:42 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:42.818213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:42.826775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:42.828254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:42.829429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-965503a3-8d94-41c5-9234-fc3724cac165 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085382 Feb 21 01:06:42.830009 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 718/1617] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:43.759389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c13220b6-42c3-4c64-ba9a-065dd2bc60ff tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:43.759955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c13220b6-42c3-4c64-ba9a-065dd2bc60ff tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:43.768488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c13220b6-42c3-4c64-ba9a-065dd2bc60ff tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:43.768939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c13220b6-42c3-4c64-ba9a-065dd2bc60ff tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:43.769714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c13220b6-42c3-4c64-ba9a-065dd2bc60ff tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:43.770218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c13220b6-42c3-4c64-ba9a-065dd2bc60ff tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:43.832707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cbfab16b-039c-4aa6-a40e-8a110a53c595 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:43.833331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cbfab16b-039c-4aa6-a40e-8a110a53c595 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:43.839707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cbfab16b-039c-4aa6-a40e-8a110a53c595 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:43.840183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cbfab16b-039c-4aa6-a40e-8a110a53c595 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:43.841009 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cbfab16b-039c-4aa6-a40e-8a110a53c595 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:43.841434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cbfab16b-039c-4aa6-a40e-8a110a53c595 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:43.915182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c13220b6-42c3-4c64-ba9a-065dd2bc60ff tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:43.923016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c13220b6-42c3-4c64-ba9a-065dd2bc60ff tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.167376 Feb 21 01:06:43.923789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 900/1618] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:43 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:43.928380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:43.928998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:43.935039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:43.935461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:43.936226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:43.936682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:43.978510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cbfab16b-039c-4aa6-a40e-8a110a53c595 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:43.986725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cbfab16b-039c-4aa6-a40e-8a110a53c595 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157763 Feb 21 01:06:43.987301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 719/1619] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:43 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:43.997155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:44.005779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:44.007254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:44.009115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9f92c682-5453-4eb9-91c2-5fdc07786c08 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083942 Feb 21 01:06:44.010215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 901/1620] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:44.944269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6c0e2c96-1755-4e32-bdae-8e7b8fcf9d9a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:44.945196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6c0e2c96-1755-4e32-bdae-8e7b8fcf9d9a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:44.952960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c0e2c96-1755-4e32-bdae-8e7b8fcf9d9a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:44.953455 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c0e2c96-1755-4e32-bdae-8e7b8fcf9d9a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:44.954310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c0e2c96-1755-4e32-bdae-8e7b8fcf9d9a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:44.954777 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c0e2c96-1755-4e32-bdae-8e7b8fcf9d9a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:45.003825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-77d116b5-a2fb-4116-9c98-736ec4789b2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:45.004498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-77d116b5-a2fb-4116-9c98-736ec4789b2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:45.011248 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-77d116b5-a2fb-4116-9c98-736ec4789b2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:45.011681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-77d116b5-a2fb-4116-9c98-736ec4789b2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:45.012479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-77d116b5-a2fb-4116-9c98-736ec4789b2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:45.012935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-77d116b5-a2fb-4116-9c98-736ec4789b2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:45.094634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6c0e2c96-1755-4e32-bdae-8e7b8fcf9d9a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:45.102900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6c0e2c96-1755-4e32-bdae-8e7b8fcf9d9a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.164979 Feb 21 01:06:45.103439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 720/1621] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:44 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:45.107617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:45.108238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:45.114568 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:45.115011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:45.115797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:45.116215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:45.164340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-77d116b5-a2fb-4116-9c98-736ec4789b2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:45.173654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-77d116b5-a2fb-4116-9c98-736ec4789b2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.174207 Feb 21 01:06:45.174229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 902/1622] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:44 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:45.187525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:45.196246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:45.197657 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:45.198795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d7861032-6a7c-4b04-a77c-7ec497b54a09 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094422 Feb 21 01:06:45.199352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 721/1623] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:45 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:46.123292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c68c53e9-1897-40c0-9553-01ed1d76249c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:46.123969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c68c53e9-1897-40c0-9553-01ed1d76249c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:46.132314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c68c53e9-1897-40c0-9553-01ed1d76249c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:46.132942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c68c53e9-1897-40c0-9553-01ed1d76249c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:46.133902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c68c53e9-1897-40c0-9553-01ed1d76249c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:46.134432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c68c53e9-1897-40c0-9553-01ed1d76249c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:46.190853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4a7722d6-ab94-4e27-a869-189069516064 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:46.191548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4a7722d6-ab94-4e27-a869-189069516064 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:46.198316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a7722d6-ab94-4e27-a869-189069516064 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:46.198791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a7722d6-ab94-4e27-a869-189069516064 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:46.199567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a7722d6-ab94-4e27-a869-189069516064 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:46.199986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a7722d6-ab94-4e27-a869-189069516064 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:46.274111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c68c53e9-1897-40c0-9553-01ed1d76249c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:46.282238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c68c53e9-1897-40c0-9553-01ed1d76249c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.164460 Feb 21 01:06:46.282770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 903/1624] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:46 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:46.286995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:46.287583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:46.293618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:46.294053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:46.294819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:46.295233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:46.333499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4a7722d6-ab94-4e27-a869-189069516064 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:46.341489 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4a7722d6-ab94-4e27-a869-189069516064 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.154389 Feb 21 01:06:46.342669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 722/1625] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:46 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:46.356056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:46.364556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:46.366041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:46.367138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8930f0d7-4ab2-4c40-a4f7-483e91fce63c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083445 Feb 21 01:06:46.367657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 904/1626] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:47.303373 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a3f067c7-f881-449a-91ee-1593ce755d91 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:47.304347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a3f067c7-f881-449a-91ee-1593ce755d91 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:47.315042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3f067c7-f881-449a-91ee-1593ce755d91 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:47.315776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3f067c7-f881-449a-91ee-1593ce755d91 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:47.317119 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3f067c7-f881-449a-91ee-1593ce755d91 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:47.317821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3f067c7-f881-449a-91ee-1593ce755d91 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:47.358754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e8c99ec0-100c-4feb-a3a0-34ed43a46938 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:47.359369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e8c99ec0-100c-4feb-a3a0-34ed43a46938 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:47.365719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e8c99ec0-100c-4feb-a3a0-34ed43a46938 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:47.366168 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e8c99ec0-100c-4feb-a3a0-34ed43a46938 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:47.366933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e8c99ec0-100c-4feb-a3a0-34ed43a46938 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:47.367354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e8c99ec0-100c-4feb-a3a0-34ed43a46938 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:47.453614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a3f067c7-f881-449a-91ee-1593ce755d91 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:47.461594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a3f067c7-f881-449a-91ee-1593ce755d91 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.164654 Feb 21 01:06:47.462194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 723/1627] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:47 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:47.471195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:47.471195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:47.473203 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:47.473642 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:47.474406 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:47.474830 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:47.508800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e8c99ec0-100c-4feb-a3a0-34ed43a46938 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:47.516651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e8c99ec0-100c-4feb-a3a0-34ed43a46938 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.161447 Feb 21 01:06:47.517401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 905/1628] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:47 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:47.539259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:47.548306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:47.549946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:47.551142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-efa42cb0-f965-4e12-9a9c-1d3009805a6c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088023 Feb 21 01:06:47.551738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 724/1629] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:47 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:48.482513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-88a0b876-3a9e-4f5f-b4ab-bac5051bc2ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:48.483437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-88a0b876-3a9e-4f5f-b4ab-bac5051bc2ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:48.494075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-88a0b876-3a9e-4f5f-b4ab-bac5051bc2ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:48.494888 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-88a0b876-3a9e-4f5f-b4ab-bac5051bc2ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:48.495680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-88a0b876-3a9e-4f5f-b4ab-bac5051bc2ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:48.496092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-88a0b876-3a9e-4f5f-b4ab-bac5051bc2ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:48.534307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c525b35f-33d8-4136-b11a-b7d8d59cdc9d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:48.535509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c525b35f-33d8-4136-b11a-b7d8d59cdc9d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:48.542493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c525b35f-33d8-4136-b11a-b7d8d59cdc9d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:48.542939 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c525b35f-33d8-4136-b11a-b7d8d59cdc9d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:48.543733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c525b35f-33d8-4136-b11a-b7d8d59cdc9d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:48.544171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c525b35f-33d8-4136-b11a-b7d8d59cdc9d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:48.631196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-88a0b876-3a9e-4f5f-b4ab-bac5051bc2ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:48.639743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-88a0b876-3a9e-4f5f-b4ab-bac5051bc2ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163405 Feb 21 01:06:48.640308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 906/1630] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:48 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:48.644995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:48.645779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:48.652138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:48.652616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:48.653385 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:48.653818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:48.679422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c525b35f-33d8-4136-b11a-b7d8d59cdc9d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:48.689198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c525b35f-33d8-4136-b11a-b7d8d59cdc9d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158209 Feb 21 01:06:48.690169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 725/1631] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:48 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:48.721166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:48.730648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:48.732160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:48.733435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8773d459-a403-417a-bdef-365830358083 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091708 Feb 21 01:06:48.733949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 907/1632] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:49.658445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c75f8a28-6c86-4092-a7df-f0776432c3de tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:49.659121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c75f8a28-6c86-4092-a7df-f0776432c3de tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:49.666505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c75f8a28-6c86-4092-a7df-f0776432c3de tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:49.666999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c75f8a28-6c86-4092-a7df-f0776432c3de tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:49.667857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c75f8a28-6c86-4092-a7df-f0776432c3de tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:49.668384 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c75f8a28-6c86-4092-a7df-f0776432c3de tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:49.706897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7a5b97f7-16b3-43b0-bfb0-4c6bc58cf85c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:49.707540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7a5b97f7-16b3-43b0-bfb0-4c6bc58cf85c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:49.714198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a5b97f7-16b3-43b0-bfb0-4c6bc58cf85c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:49.714650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a5b97f7-16b3-43b0-bfb0-4c6bc58cf85c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:49.715433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a5b97f7-16b3-43b0-bfb0-4c6bc58cf85c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:49.715867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7a5b97f7-16b3-43b0-bfb0-4c6bc58cf85c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:49.802116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c75f8a28-6c86-4092-a7df-f0776432c3de tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:49.810237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c75f8a28-6c86-4092-a7df-f0776432c3de tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.155955 Feb 21 01:06:49.810814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 726/1633] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:49 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:49.815111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:49.815695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:49.821502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:49.821951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:49.822761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:49.823193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:49.854257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7a5b97f7-16b3-43b0-bfb0-4c6bc58cf85c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:49.862241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7a5b97f7-16b3-43b0-bfb0-4c6bc58cf85c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159075 Feb 21 01:06:49.862845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 908/1634] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:49 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:49.886417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:49.894731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:49.896212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:49.897398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-92b44348-4918-486e-a877-fa1e96a03606 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085646 Feb 21 01:06:49.897968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 727/1635] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:50.831617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7bda2100-2746-44b3-8d12-b53cb9c07def tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:50.832533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7bda2100-2746-44b3-8d12-b53cb9c07def tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:50.842990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bda2100-2746-44b3-8d12-b53cb9c07def tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:50.843711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bda2100-2746-44b3-8d12-b53cb9c07def tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:50.845035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bda2100-2746-44b3-8d12-b53cb9c07def tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:50.845746 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bda2100-2746-44b3-8d12-b53cb9c07def tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:50.878857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-960062f8-7c76-4d69-a0e8-69e76fe08244 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:50.879611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-960062f8-7c76-4d69-a0e8-69e76fe08244 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:50.886340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-960062f8-7c76-4d69-a0e8-69e76fe08244 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:50.886791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-960062f8-7c76-4d69-a0e8-69e76fe08244 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:50.887571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-960062f8-7c76-4d69-a0e8-69e76fe08244 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:50.887998 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-960062f8-7c76-4d69-a0e8-69e76fe08244 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:50.982958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7bda2100-2746-44b3-8d12-b53cb9c07def tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:50.990914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7bda2100-2746-44b3-8d12-b53cb9c07def tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.165838 Feb 21 01:06:50.991520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 909/1636] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:50 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:50.995692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:50.996283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:51.001872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:51.002314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:51.003081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:51.003510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:51.019124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-960062f8-7c76-4d69-a0e8-69e76fe08244 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:51.027354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-960062f8-7c76-4d69-a0e8-69e76fe08244 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.152167 Feb 21 01:06:51.027901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 728/1637] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:50 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:51.063493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:51.071917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:51.073503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:51.074642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1874617f-af8f-4f67-b783-73c32f36cc5d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.082215 Feb 21 01:06:51.075149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 910/1638] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:50 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:52.012201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-390d548b-1daa-4fbe-bbba-4cf4032eb568 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:52.013217 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-390d548b-1daa-4fbe-bbba-4cf4032eb568 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:52.024452 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-390d548b-1daa-4fbe-bbba-4cf4032eb568 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:52.025218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-390d548b-1daa-4fbe-bbba-4cf4032eb568 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:52.026567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-390d548b-1daa-4fbe-bbba-4cf4032eb568 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:52.027079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-390d548b-1daa-4fbe-bbba-4cf4032eb568 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:52.043957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8c614b6f-97d6-46e1-99e9-01a918cce385 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:52.044602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8c614b6f-97d6-46e1-99e9-01a918cce385 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:52.051437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c614b6f-97d6-46e1-99e9-01a918cce385 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:52.051943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c614b6f-97d6-46e1-99e9-01a918cce385 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:52.052766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c614b6f-97d6-46e1-99e9-01a918cce385 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:52.053189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c614b6f-97d6-46e1-99e9-01a918cce385 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:52.160897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-390d548b-1daa-4fbe-bbba-4cf4032eb568 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:52.168953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-390d548b-1daa-4fbe-bbba-4cf4032eb568 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163123 Feb 21 01:06:52.169557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 729/1639] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:52 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:52.173731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:52.174324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:52.179894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:52.180336 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:52.181140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:52.181569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:52.189815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8c614b6f-97d6-46e1-99e9-01a918cce385 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:52.197809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8c614b6f-97d6-46e1-99e9-01a918cce385 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157696 Feb 21 01:06:52.198415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 911/1640] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:52 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:52.244562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:52.253111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:52.254610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:52.255739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a17dfe80-54bb-437c-8946-057ad84caa04 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085287 Feb 21 01:06:52.256298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 730/1641] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:53.189489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dcfb556f-b938-4753-83ae-7dd6e4fe4dbc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:53.190472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dcfb556f-b938-4753-83ae-7dd6e4fe4dbc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:53.200205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcfb556f-b938-4753-83ae-7dd6e4fe4dbc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:53.200774 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcfb556f-b938-4753-83ae-7dd6e4fe4dbc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:53.201550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcfb556f-b938-4753-83ae-7dd6e4fe4dbc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:53.201971 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcfb556f-b938-4753-83ae-7dd6e4fe4dbc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:53.213767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-22d4b227-19a7-43bb-b7c5-03a6ee5e04e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:53.214408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-22d4b227-19a7-43bb-b7c5-03a6ee5e04e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:53.221060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-22d4b227-19a7-43bb-b7c5-03a6ee5e04e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:53.221507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-22d4b227-19a7-43bb-b7c5-03a6ee5e04e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:53.222289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-22d4b227-19a7-43bb-b7c5-03a6ee5e04e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:53.222787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-22d4b227-19a7-43bb-b7c5-03a6ee5e04e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:53.338721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dcfb556f-b938-4753-83ae-7dd6e4fe4dbc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:53.346642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dcfb556f-b938-4753-83ae-7dd6e4fe4dbc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163406 Feb 21 01:06:53.347252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 912/1642] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:53 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:53.352233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:53.353520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:53.357156 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-22d4b227-19a7-43bb-b7c5-03a6ee5e04e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:53.359433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:53.359877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:53.360689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:53.361117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:53.365303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-22d4b227-19a7-43bb-b7c5-03a6ee5e04e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.155250 Feb 21 01:06:53.365883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 731/1643] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:53 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:53.421588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:53.429923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:53.431400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:53.432528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-057a9d33-6454-49d4-ad70-4d53bcb771fe tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.084365 Feb 21 01:06:53.433158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 913/1644] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:53 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:54.365189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f0e5d805-1904-4b85-b67b-22237134ae0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:54.365942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f0e5d805-1904-4b85-b67b-22237134ae0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:54.373562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0e5d805-1904-4b85-b67b-22237134ae0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:54.373991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0e5d805-1904-4b85-b67b-22237134ae0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:54.374765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0e5d805-1904-4b85-b67b-22237134ae0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:54.375180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0e5d805-1904-4b85-b67b-22237134ae0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:54.382187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0e9796fd-58f4-4e53-a12b-ebf62efe72a5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:54.382802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0e9796fd-58f4-4e53-a12b-ebf62efe72a5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:54.389398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0e9796fd-58f4-4e53-a12b-ebf62efe72a5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:54.389839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0e9796fd-58f4-4e53-a12b-ebf62efe72a5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:54.390617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0e9796fd-58f4-4e53-a12b-ebf62efe72a5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:54.391043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0e9796fd-58f4-4e53-a12b-ebf62efe72a5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:54.507962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f0e5d805-1904-4b85-b67b-22237134ae0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:54.515952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f0e5d805-1904-4b85-b67b-22237134ae0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.155583 Feb 21 01:06:54.516560 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 732/1645] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:54 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:54.524553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0e9796fd-58f4-4e53-a12b-ebf62efe72a5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:54.527334 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:54.527983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:54.532150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0e9796fd-58f4-4e53-a12b-ebf62efe72a5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.153642 Feb 21 01:06:54.534193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:54.534640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:54.535796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:54.536261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:54.541752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 914/1646] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:54 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:54.598631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:54.609004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:54.611395 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:54.613223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-143821f9-ef95-4f01-91be-707bd6946b14 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095440 Feb 21 01:06:54.613989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 733/1647] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:54 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:55.538128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0b64beb1-d171-4bb9-bd05-88cc350608e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:55.539129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0b64beb1-d171-4bb9-bd05-88cc350608e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:55.547489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0b64beb1-d171-4bb9-bd05-88cc350608e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:55.547935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0b64beb1-d171-4bb9-bd05-88cc350608e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:55.548759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0b64beb1-d171-4bb9-bd05-88cc350608e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:55.549081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-84369932-3885-4d38-9220-e30e070cab17 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:55.549550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0b64beb1-d171-4bb9-bd05-88cc350608e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:55.549661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-84369932-3885-4d38-9220-e30e070cab17 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:55.556241 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84369932-3885-4d38-9220-e30e070cab17 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:55.556722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84369932-3885-4d38-9220-e30e070cab17 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:55.557556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84369932-3885-4d38-9220-e30e070cab17 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:55.557980 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84369932-3885-4d38-9220-e30e070cab17 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:55.685590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0b64beb1-d171-4bb9-bd05-88cc350608e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:55.689225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-84369932-3885-4d38-9220-e30e070cab17 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:55.694504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0b64beb1-d171-4bb9-bd05-88cc350608e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.162853 Feb 21 01:06:55.695089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 915/1648] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:55 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:55.699469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:55.699879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-84369932-3885-4d38-9220-e30e070cab17 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.154437 Feb 21 01:06:55.700214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:55.701067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 734/1649] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:55 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:55.705967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:55.706406 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:55.707201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:55.707623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:55.772155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:55.781597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:55.783064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:55.784183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-78377f57-3d77-44e6-b147-33d1c9724aa7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088166 Feb 21 01:06:55.784740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 916/1650] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:56.715087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-06b4d786-6fe5-4a4e-a788-e20f5bc78db5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:56.715704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-06b4d786-6fe5-4a4e-a788-e20f5bc78db5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:56.718083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dfc777d6-1514-46bd-ba23-449d47020c83 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:56.718689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dfc777d6-1514-46bd-ba23-449d47020c83 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:56.722350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-06b4d786-6fe5-4a4e-a788-e20f5bc78db5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:56.722872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-06b4d786-6fe5-4a4e-a788-e20f5bc78db5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:56.723649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-06b4d786-6fe5-4a4e-a788-e20f5bc78db5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:56.724076 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-06b4d786-6fe5-4a4e-a788-e20f5bc78db5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:56.725447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dfc777d6-1514-46bd-ba23-449d47020c83 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:56.725886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dfc777d6-1514-46bd-ba23-449d47020c83 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:56.726657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dfc777d6-1514-46bd-ba23-449d47020c83 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:56.727075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dfc777d6-1514-46bd-ba23-449d47020c83 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:56.859017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-06b4d786-6fe5-4a4e-a788-e20f5bc78db5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:56.862924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dfc777d6-1514-46bd-ba23-449d47020c83 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:56.867056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-06b4d786-6fe5-4a4e-a788-e20f5bc78db5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.157822 Feb 21 01:06:56.867655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 735/1651] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:56 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:56.871097 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dfc777d6-1514-46bd-ba23-449d47020c83 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157081 Feb 21 01:06:56.871898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 917/1652] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:56 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:56.872029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:56.872651 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:56.878589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:56.879027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:56.879793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:56.880203 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:56.943111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:56.953481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:56.954965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:56.956114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4c99ac3d-24d8-4687-a364-69e8c60b8149 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087527 Feb 21 01:06:56.956697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 736/1653] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:56 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:57.883275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-054bf46c-1a34-494a-af62-9432d98a3e89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:57.883908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-054bf46c-1a34-494a-af62-9432d98a3e89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:57.887752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8fa1ae57-fb0e-40ad-a995-6d79a1832296 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:57.888366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8fa1ae57-fb0e-40ad-a995-6d79a1832296 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:57.891290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-054bf46c-1a34-494a-af62-9432d98a3e89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:57.891736 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-054bf46c-1a34-494a-af62-9432d98a3e89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:57.892545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-054bf46c-1a34-494a-af62-9432d98a3e89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:57.892983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-054bf46c-1a34-494a-af62-9432d98a3e89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:57.894529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8fa1ae57-fb0e-40ad-a995-6d79a1832296 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:57.894979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8fa1ae57-fb0e-40ad-a995-6d79a1832296 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:57.895749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8fa1ae57-fb0e-40ad-a995-6d79a1832296 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:57.896168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8fa1ae57-fb0e-40ad-a995-6d79a1832296 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:58.038222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8fa1ae57-fb0e-40ad-a995-6d79a1832296 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:58.042063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-054bf46c-1a34-494a-af62-9432d98a3e89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:58.046289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8fa1ae57-fb0e-40ad-a995-6d79a1832296 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162851 Feb 21 01:06:58.046860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 737/1654] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:57 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:58.050077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-054bf46c-1a34-494a-af62-9432d98a3e89 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.170563 Feb 21 01:06:58.050922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 918/1655] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:57 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:58.051136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:58.051737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:58.057738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:58.058214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:58.058975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:58.059400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:58.118905 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:58.130548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:58.133184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:58.134858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e7568665-7279-48bb-bcf4-a7cab5da4f19 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086782 Feb 21 01:06:58.135492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 738/1656] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:59.065263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2f441210-2abb-4631-a935-50d33c7f17c2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:59.065998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2f441210-2abb-4631-a935-50d33c7f17c2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:59.068701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9e795e1b-749a-4162-a6f3-1cdcdc4c135d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:59.069463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9e795e1b-749a-4162-a6f3-1cdcdc4c135d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:59.074437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f441210-2abb-4631-a935-50d33c7f17c2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:59.074991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f441210-2abb-4631-a935-50d33c7f17c2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:59.076022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f441210-2abb-4631-a935-50d33c7f17c2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:59.076608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f441210-2abb-4631-a935-50d33c7f17c2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:59.077215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9e795e1b-749a-4162-a6f3-1cdcdc4c135d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:59.077793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9e795e1b-749a-4162-a6f3-1cdcdc4c135d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:59.078758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9e795e1b-749a-4162-a6f3-1cdcdc4c135d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:59.079299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9e795e1b-749a-4162-a6f3-1cdcdc4c135d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:59.213112 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2f441210-2abb-4631-a935-50d33c7f17c2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:59.221827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2f441210-2abb-4631-a935-50d33c7f17c2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.161232 Feb 21 01:06:59.222632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 919/1657] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:59 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:06:59.226904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:06:59.227516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:06:59.233849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:59.234295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:59.235083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:06:59.235505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:06:59.297556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:59.306202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:59.307670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:59.308903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-24d366a9-dbbd-4e9c-bd97-2dc5eca1c8c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085443 Feb 21 01:06:59.309472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 920/1658] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:06:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:06:59.455387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9e795e1b-749a-4162-a6f3-1cdcdc4c135d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:06:59.466545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9e795e1b-749a-4162-a6f3-1cdcdc4c135d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.402155 Feb 21 01:06:59.471186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 739/1659] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:06:59 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:00.239499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-43c0a8dd-1144-403c-a67e-5b830dd44843 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:00.240114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-43c0a8dd-1144-403c-a67e-5b830dd44843 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:00.246926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43c0a8dd-1144-403c-a67e-5b830dd44843 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:00.247370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43c0a8dd-1144-403c-a67e-5b830dd44843 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:00.248144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43c0a8dd-1144-403c-a67e-5b830dd44843 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:00.248611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-43c0a8dd-1144-403c-a67e-5b830dd44843 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:00.327255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:00.327962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:00.334987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:00.335422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:00.336254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:00.336807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:00.396920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-43c0a8dd-1144-403c-a67e-5b830dd44843 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:00.400077 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:00.405599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-43c0a8dd-1144-403c-a67e-5b830dd44843 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169769 Feb 21 01:07:00.406634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 921/1660] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:00 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:00.408954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:00.410460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:00.411632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-19d13929-95fc-4c37-a5d0-28915140bbe2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088545 Feb 21 01:07:00.412194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 740/1661] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:00 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:00.485010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8c20a4e3-4b87-44f5-a700-25f114863be3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:00.485616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8c20a4e3-4b87-44f5-a700-25f114863be3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:00.492494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c20a4e3-4b87-44f5-a700-25f114863be3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:00.492889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c20a4e3-4b87-44f5-a700-25f114863be3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:00.493669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c20a4e3-4b87-44f5-a700-25f114863be3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:00.494098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8c20a4e3-4b87-44f5-a700-25f114863be3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:00.653146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8c20a4e3-4b87-44f5-a700-25f114863be3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:00.664788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8c20a4e3-4b87-44f5-a700-25f114863be3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.183131 Feb 21 01:07:00.665768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 922/1662] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:00 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:01.427506 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b5e8b6ab-d0c4-499c-afb3-3e3060f26bc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:01.428471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b5e8b6ab-d0c4-499c-afb3-3e3060f26bc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:01.432165 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:01.433605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:01.439244 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5e8b6ab-d0c4-499c-afb3-3e3060f26bc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:01.439993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5e8b6ab-d0c4-499c-afb3-3e3060f26bc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:01.441399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5e8b6ab-d0c4-499c-afb3-3e3060f26bc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:01.442117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5e8b6ab-d0c4-499c-afb3-3e3060f26bc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:01.444673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:01.445417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:01.446691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:01.447397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:01.507581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:01.516103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:01.517634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:01.518824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0729a6d4-54c2-4ad3-895a-cc5fcbc8f9e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092900 Feb 21 01:07:01.519410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 923/1663] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:01.577243 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b5e8b6ab-d0c4-499c-afb3-3e3060f26bc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:01.585252 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b5e8b6ab-d0c4-499c-afb3-3e3060f26bc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164314 Feb 21 01:07:01.585843 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 741/1664] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:01 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:01.686887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7c0b8781-9b35-4f17-b5d1-fe889998b872 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:01.687602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7c0b8781-9b35-4f17-b5d1-fe889998b872 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:01.697066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c0b8781-9b35-4f17-b5d1-fe889998b872 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:01.697650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c0b8781-9b35-4f17-b5d1-fe889998b872 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:01.698785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c0b8781-9b35-4f17-b5d1-fe889998b872 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:01.699450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c0b8781-9b35-4f17-b5d1-fe889998b872 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:01.844430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7c0b8781-9b35-4f17-b5d1-fe889998b872 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:01.856648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7c0b8781-9b35-4f17-b5d1-fe889998b872 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.176260 Feb 21 01:07:01.857243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 924/1665] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:01 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:02.540454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:02.541498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:02.552545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:02.553277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:02.554542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:02.555255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:02.602385 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-517f4a53-ed8b-4e82-9b8c-a63fe9a3740c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:02.603022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-517f4a53-ed8b-4e82-9b8c-a63fe9a3740c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:02.609413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-517f4a53-ed8b-4e82-9b8c-a63fe9a3740c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:02.609838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-517f4a53-ed8b-4e82-9b8c-a63fe9a3740c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:02.610604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-517f4a53-ed8b-4e82-9b8c-a63fe9a3740c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:02.611022 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-517f4a53-ed8b-4e82-9b8c-a63fe9a3740c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:02.619508 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:02.628265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:02.629782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:02.630917 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dc2fd2ca-6c6d-478a-8584-0a4e9055990a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096694 Feb 21 01:07:02.631691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 742/1666] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:02.744505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-517f4a53-ed8b-4e82-9b8c-a63fe9a3740c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:02.752559 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-517f4a53-ed8b-4e82-9b8c-a63fe9a3740c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.153848 Feb 21 01:07:02.753097 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 925/1667] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:02 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:07:02.878402 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f1f2b6c1-0a35-468e-bff3-ae85b02ae7fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:02.879273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f1f2b6c1-0a35-468e-bff3-ae85b02ae7fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:02.888544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1f2b6c1-0a35-468e-bff3-ae85b02ae7fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:02.888985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1f2b6c1-0a35-468e-bff3-ae85b02ae7fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:02.889794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1f2b6c1-0a35-468e-bff3-ae85b02ae7fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:02.890218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1f2b6c1-0a35-468e-bff3-ae85b02ae7fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:03.025899 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f1f2b6c1-0a35-468e-bff3-ae85b02ae7fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:03.034011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f1f2b6c1-0a35-468e-bff3-ae85b02ae7fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.163324 Feb 21 01:07:03.034585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 743/1668] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:02 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:03.655143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:03.656142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:03.667225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:03.667992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:03.668811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:03.669233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:03.739185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:03.747642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:03.749148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:03.750264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-341c2588-22f9-4e51-a303-fc24091244dd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101902 Feb 21 01:07:03.750818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 926/1669] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:03.768949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-503f7e3d-3714-41ad-b98d-0581af6ec53a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:03.769566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-503f7e3d-3714-41ad-b98d-0581af6ec53a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:03.776339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-503f7e3d-3714-41ad-b98d-0581af6ec53a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:03.776812 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-503f7e3d-3714-41ad-b98d-0581af6ec53a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:03.777663 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-503f7e3d-3714-41ad-b98d-0581af6ec53a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:03.778088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-503f7e3d-3714-41ad-b98d-0581af6ec53a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:03.915745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-503f7e3d-3714-41ad-b98d-0581af6ec53a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:03.924664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-503f7e3d-3714-41ad-b98d-0581af6ec53a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159336 Feb 21 01:07:03.925253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 744/1670] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:03 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:04.054219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-89d14bf5-8cbd-48bf-a3a1-8523b76e1f55 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:04.055211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-89d14bf5-8cbd-48bf-a3a1-8523b76e1f55 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:04.062982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89d14bf5-8cbd-48bf-a3a1-8523b76e1f55 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:04.063431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89d14bf5-8cbd-48bf-a3a1-8523b76e1f55 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:04.064228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89d14bf5-8cbd-48bf-a3a1-8523b76e1f55 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:04.064689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89d14bf5-8cbd-48bf-a3a1-8523b76e1f55 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:04.200903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-89d14bf5-8cbd-48bf-a3a1-8523b76e1f55 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:04.208784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-89d14bf5-8cbd-48bf-a3a1-8523b76e1f55 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.160357 Feb 21 01:07:04.209353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 927/1671] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:04 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:04.774034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:04.774992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:04.782572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:04.782949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:04.783751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:04.784175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:04.855919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:04.864903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:04.866377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:04.867511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ba600d83-742f-48ba-aa59-75c9067e1b89 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100206 Feb 21 01:07:04.868069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 745/1672] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:04.945926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eb9bba5c-c387-4380-9220-28765c5dfc12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:04.947014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eb9bba5c-c387-4380-9220-28765c5dfc12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:04.957992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb9bba5c-c387-4380-9220-28765c5dfc12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:04.958725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb9bba5c-c387-4380-9220-28765c5dfc12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:04.960026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb9bba5c-c387-4380-9220-28765c5dfc12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:04.960808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eb9bba5c-c387-4380-9220-28765c5dfc12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:05.095167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eb9bba5c-c387-4380-9220-28765c5dfc12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:05.103344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eb9bba5c-c387-4380-9220-28765c5dfc12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163826 Feb 21 01:07:05.103885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 928/1673] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:04 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:05.229727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-df065720-c468-45d1-ba7a-b1eb0a8523ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:05.230747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-df065720-c468-45d1-ba7a-b1eb0a8523ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:05.238561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df065720-c468-45d1-ba7a-b1eb0a8523ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:05.239131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df065720-c468-45d1-ba7a-b1eb0a8523ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:05.240096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df065720-c468-45d1-ba7a-b1eb0a8523ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:05.240722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df065720-c468-45d1-ba7a-b1eb0a8523ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:05.384419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-df065720-c468-45d1-ba7a-b1eb0a8523ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:05.392805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-df065720-c468-45d1-ba7a-b1eb0a8523ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.169326 Feb 21 01:07:05.393356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 746/1674] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:05 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:05.888684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:05.889515 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:05.897888 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:05.898801 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:05.899834 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:05.900449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:05.969521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:05.978074 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:05.979563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:05.980754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9825c0e9-849e-4cd0-aea0-9337da15cdaa tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098508 Feb 21 01:07:05.981341 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 929/1675] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:06.121745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b8f6265a-520a-4a2f-9942-53fe6fcbff84 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:06.122351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b8f6265a-520a-4a2f-9942-53fe6fcbff84 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:06.129563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8f6265a-520a-4a2f-9942-53fe6fcbff84 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:06.130206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8f6265a-520a-4a2f-9942-53fe6fcbff84 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:06.131355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8f6265a-520a-4a2f-9942-53fe6fcbff84 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:06.131870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b8f6265a-520a-4a2f-9942-53fe6fcbff84 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:06.271297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b8f6265a-520a-4a2f-9942-53fe6fcbff84 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:06.280078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b8f6265a-520a-4a2f-9942-53fe6fcbff84 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162604 Feb 21 01:07:06.280665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 747/1676] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:06 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:06.419987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-37242c30-2781-4dc6-aab1-0f6acb1b130e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:06.421033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-37242c30-2781-4dc6-aab1-0f6acb1b130e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:06.431514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37242c30-2781-4dc6-aab1-0f6acb1b130e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:06.432245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37242c30-2781-4dc6-aab1-0f6acb1b130e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:06.433540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37242c30-2781-4dc6-aab1-0f6acb1b130e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:06.433967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-37242c30-2781-4dc6-aab1-0f6acb1b130e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:06.570310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-37242c30-2781-4dc6-aab1-0f6acb1b130e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:06.579864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-37242c30-2781-4dc6-aab1-0f6acb1b130e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.167157 Feb 21 01:07:06.580423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 930/1677] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:06 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:07.002415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:07.003477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:07.013557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:07.014292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:07.015557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:07.016282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:07.093640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:07.102050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:07.103514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:07.104669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3a9679e7-8bf7-4ea4-8c83-6d264c4c8fdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.108454 Feb 21 01:07:07.105248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 748/1678] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:06 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:07.301461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ad06bde8-d105-4618-ac2b-c3037801e983 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:07.302338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ad06bde8-d105-4618-ac2b-c3037801e983 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:07.312933 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad06bde8-d105-4618-ac2b-c3037801e983 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:07.313679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad06bde8-d105-4618-ac2b-c3037801e983 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:07.314948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad06bde8-d105-4618-ac2b-c3037801e983 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:07.315661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad06bde8-d105-4618-ac2b-c3037801e983 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:07.457241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ad06bde8-d105-4618-ac2b-c3037801e983 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:07.465317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ad06bde8-d105-4618-ac2b-c3037801e983 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.170211 Feb 21 01:07:07.466068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 931/1679] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:07 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:07.600833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f1d0b012-4b77-41e6-a837-cfc4585d753a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:07.601706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f1d0b012-4b77-41e6-a837-cfc4585d753a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:07.609831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1d0b012-4b77-41e6-a837-cfc4585d753a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:07.610271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1d0b012-4b77-41e6-a837-cfc4585d753a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:07.611066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1d0b012-4b77-41e6-a837-cfc4585d753a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:07.611495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1d0b012-4b77-41e6-a837-cfc4585d753a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:07.752175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f1d0b012-4b77-41e6-a837-cfc4585d753a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:07.766136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f1d0b012-4b77-41e6-a837-cfc4585d753a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.171814 Feb 21 01:07:07.766948 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 749/1680] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:07 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:07:08.125871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:08.126871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:08.136898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:08.137347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:08.138119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:08.138549 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:08.208737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:08.221720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:08.223978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:08.225692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9cd0861c-237c-4545-95f9-cb62d3e2c709 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.105904 Feb 21 01:07:08.226453 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 932/1681] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:08.489738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5c266c60-511b-4094-865b-646e2d27be38 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:08.490735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5c266c60-511b-4094-865b-646e2d27be38 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:08.499075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c266c60-511b-4094-865b-646e2d27be38 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:08.499562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c266c60-511b-4094-865b-646e2d27be38 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:08.500337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c266c60-511b-4094-865b-646e2d27be38 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:08.500798 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5c266c60-511b-4094-865b-646e2d27be38 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:08.653807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5c266c60-511b-4094-865b-646e2d27be38 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:08.662319 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5c266c60-511b-4094-865b-646e2d27be38 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.178944 Feb 21 01:07:08.662892 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 750/1682] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:08 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:08.787244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-035ada4c-8d94-4092-afb6-53c6d70414f7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:08.788135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-035ada4c-8d94-4092-afb6-53c6d70414f7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:08.797026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-035ada4c-8d94-4092-afb6-53c6d70414f7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:08.797471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-035ada4c-8d94-4092-afb6-53c6d70414f7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:08.798246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-035ada4c-8d94-4092-afb6-53c6d70414f7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:08.798674 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-035ada4c-8d94-4092-afb6-53c6d70414f7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:08.948080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-035ada4c-8d94-4092-afb6-53c6d70414f7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:08.957002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-035ada4c-8d94-4092-afb6-53c6d70414f7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.176186 Feb 21 01:07:08.957605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 933/1683] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:08 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:09.248791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:09.249599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:09.257628 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:09.258185 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:09.259149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:09.259687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:09.326592 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:09.334849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:09.336337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:09.337518 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-78dfca60-e994-4273-86c3-ac48ccd2e3e3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094938 Feb 21 01:07:09.338059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 751/1684] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:09.683418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8e843c7b-adc6-46ee-b61c-ed2dbde13570 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:09.684449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8e843c7b-adc6-46ee-b61c-ed2dbde13570 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:09.695359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e843c7b-adc6-46ee-b61c-ed2dbde13570 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:09.696084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e843c7b-adc6-46ee-b61c-ed2dbde13570 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:09.697417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e843c7b-adc6-46ee-b61c-ed2dbde13570 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:09.698108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8e843c7b-adc6-46ee-b61c-ed2dbde13570 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:09.836871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8e843c7b-adc6-46ee-b61c-ed2dbde13570 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:09.846994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8e843c7b-adc6-46ee-b61c-ed2dbde13570 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169649 Feb 21 01:07:09.847566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 934/1685] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:09 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:09.977966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cb765d57-a82c-46f6-82ca-99b6f8a614d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:09.978972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cb765d57-a82c-46f6-82ca-99b6f8a614d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:09.989914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cb765d57-a82c-46f6-82ca-99b6f8a614d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:09.990648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cb765d57-a82c-46f6-82ca-99b6f8a614d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:09.991982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cb765d57-a82c-46f6-82ca-99b6f8a614d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:09.992749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cb765d57-a82c-46f6-82ca-99b6f8a614d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:10.131346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cb765d57-a82c-46f6-82ca-99b6f8a614d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:10.139942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cb765d57-a82c-46f6-82ca-99b6f8a614d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.168189 Feb 21 01:07:10.140548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 752/1686] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:09 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:10.360698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:10.361571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:10.371471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:10.372200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:10.373592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:10.374300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:10.443019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:10.451364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:10.452916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:10.454036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-905f3ef8-0eb0-4a5f-a626-0fc79e4443a6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.099831 Feb 21 01:07:10.454624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 935/1687] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:10 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:10.868316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2608449c-d26e-493b-b3c5-77bb86e86c91 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:10.869349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2608449c-d26e-493b-b3c5-77bb86e86c91 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:10.877682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2608449c-d26e-493b-b3c5-77bb86e86c91 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:10.878146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2608449c-d26e-493b-b3c5-77bb86e86c91 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:10.878946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2608449c-d26e-493b-b3c5-77bb86e86c91 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:10.879390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2608449c-d26e-493b-b3c5-77bb86e86c91 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:11.023759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2608449c-d26e-493b-b3c5-77bb86e86c91 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:11.031625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2608449c-d26e-493b-b3c5-77bb86e86c91 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169409 Feb 21 01:07:11.032190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 753/1688] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:10 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:11.161191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-043ac3a7-0cda-4a1d-be37-f5344484496e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:11.162189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-043ac3a7-0cda-4a1d-be37-f5344484496e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:11.171869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-043ac3a7-0cda-4a1d-be37-f5344484496e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:11.172306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-043ac3a7-0cda-4a1d-be37-f5344484496e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:11.173105 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-043ac3a7-0cda-4a1d-be37-f5344484496e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:11.173524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-043ac3a7-0cda-4a1d-be37-f5344484496e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:11.316208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-043ac3a7-0cda-4a1d-be37-f5344484496e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:11.324311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-043ac3a7-0cda-4a1d-be37-f5344484496e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.169317 Feb 21 01:07:11.324945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 936/1689] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:11 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:11.471426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:11.471965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:11.478502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:11.478950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:11.479723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:11.480157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:11.542546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:11.550925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:11.552438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:11.553571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ad2e8135-e9d3-4c5c-84d6-2f92e0be9089 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086177 Feb 21 01:07:11.554125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 754/1690] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:12.050120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bc249f6b-3984-4ec2-b9cb-0cb56bbd7515 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:12.050726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bc249f6b-3984-4ec2-b9cb-0cb56bbd7515 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:12.057208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc249f6b-3984-4ec2-b9cb-0cb56bbd7515 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:12.057653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc249f6b-3984-4ec2-b9cb-0cb56bbd7515 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:12.058420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc249f6b-3984-4ec2-b9cb-0cb56bbd7515 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:12.058847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc249f6b-3984-4ec2-b9cb-0cb56bbd7515 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:12.204597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bc249f6b-3984-4ec2-b9cb-0cb56bbd7515 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:12.212362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bc249f6b-3984-4ec2-b9cb-0cb56bbd7515 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165992 Feb 21 01:07:12.212990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 937/1691] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:12 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:12.344352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b058fcb5-83b0-4336-bbd3-61f5e3e06e92 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:12.345136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b058fcb5-83b0-4336-bbd3-61f5e3e06e92 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:12.354108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b058fcb5-83b0-4336-bbd3-61f5e3e06e92 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:12.354707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b058fcb5-83b0-4336-bbd3-61f5e3e06e92 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:12.355749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b058fcb5-83b0-4336-bbd3-61f5e3e06e92 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:12.356320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b058fcb5-83b0-4336-bbd3-61f5e3e06e92 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:12.503063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b058fcb5-83b0-4336-bbd3-61f5e3e06e92 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:12.514909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b058fcb5-83b0-4336-bbd3-61f5e3e06e92 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.176624 Feb 21 01:07:12.515471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 755/1692] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:12 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:12.571412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:12.572012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:12.578430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:12.578879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:12.579624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:12.580045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:12.645314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:12.656284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:12.657987 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:12.659956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0acde1de-fefe-4d87-9107-be20e14d03db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091992 Feb 21 01:07:12.661013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 938/1693] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:13.233184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-505fdde9-403f-45ea-996c-56c3850b8a2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:13.233824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-505fdde9-403f-45ea-996c-56c3850b8a2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:13.240138 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-505fdde9-403f-45ea-996c-56c3850b8a2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:13.240626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-505fdde9-403f-45ea-996c-56c3850b8a2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:13.241395 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-505fdde9-403f-45ea-996c-56c3850b8a2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:13.241829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-505fdde9-403f-45ea-996c-56c3850b8a2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:13.373580 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-505fdde9-403f-45ea-996c-56c3850b8a2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:13.381451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-505fdde9-403f-45ea-996c-56c3850b8a2c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.154545 Feb 21 01:07:13.382046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 756/1694] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:13 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:13.533940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0d673655-0644-4fdf-afa8-9273b4b31af5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:13.534591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0d673655-0644-4fdf-afa8-9273b4b31af5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:13.542975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d673655-0644-4fdf-afa8-9273b4b31af5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:13.543679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d673655-0644-4fdf-afa8-9273b4b31af5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:13.544986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d673655-0644-4fdf-afa8-9273b4b31af5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:13.545563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d673655-0644-4fdf-afa8-9273b4b31af5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:13.681985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:13.682623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:13.686183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0d673655-0644-4fdf-afa8-9273b4b31af5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:13.689118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:13.689565 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:13.690369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:13.690884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:13.694676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0d673655-0644-4fdf-afa8-9273b4b31af5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.164873 Feb 21 01:07:13.695259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 939/1695] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:13 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:13.755869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:13.764226 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:13.765743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:13.766878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-966383ea-db20-425a-9a4e-45b9ecd42156 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088764 Feb 21 01:07:13.767437 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 757/1696] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:14.401996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1b7d3174-9fd4-4e04-bfd9-5671a99dd54c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:14.402738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1b7d3174-9fd4-4e04-bfd9-5671a99dd54c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:14.409444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b7d3174-9fd4-4e04-bfd9-5671a99dd54c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:14.409969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b7d3174-9fd4-4e04-bfd9-5671a99dd54c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:14.410748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b7d3174-9fd4-4e04-bfd9-5671a99dd54c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:14.411197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1b7d3174-9fd4-4e04-bfd9-5671a99dd54c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:14.542384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1b7d3174-9fd4-4e04-bfd9-5671a99dd54c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:14.550680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1b7d3174-9fd4-4e04-bfd9-5671a99dd54c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.152976 Feb 21 01:07:14.551266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 940/1697] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:14 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:07:14.716147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b3444e39-ff60-447e-9448-e2da928f5da5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:14.717250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b3444e39-ff60-447e-9448-e2da928f5da5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:14.723815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b3444e39-ff60-447e-9448-e2da928f5da5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:14.724238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b3444e39-ff60-447e-9448-e2da928f5da5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:14.725068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b3444e39-ff60-447e-9448-e2da928f5da5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:14.725504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b3444e39-ff60-447e-9448-e2da928f5da5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:14.784907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:14.785640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:14.791676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:14.792117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:14.792910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:14.793338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:14.855969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:14.864463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:14.865946 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:14.867084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-df4760d9-877d-4acd-bd67-cf2bfbb81271 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085994 Feb 21 01:07:14.867647 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 941/1698] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:07:14.868523 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b3444e39-ff60-447e-9448-e2da928f5da5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:14.876369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b3444e39-ff60-447e-9448-e2da928f5da5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.166660 Feb 21 01:07:14.876940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 758/1699] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:14 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:15.567098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6c818e86-eba9-4161-91f7-577dc917cfb1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:15.567709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6c818e86-eba9-4161-91f7-577dc917cfb1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:15.574857 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6c818e86-eba9-4161-91f7-577dc917cfb1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:15.575300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6c818e86-eba9-4161-91f7-577dc917cfb1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:15.576072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6c818e86-eba9-4161-91f7-577dc917cfb1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:15.576614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6c818e86-eba9-4161-91f7-577dc917cfb1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:15.719548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6c818e86-eba9-4161-91f7-577dc917cfb1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:15.727809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6c818e86-eba9-4161-91f7-577dc917cfb1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164374 Feb 21 01:07:15.728319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 942/1700] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:15 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:15.889976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:15.890590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:15.894045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c6431de2-0454-4087-99c8-b6164de83299 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:15.894688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c6431de2-0454-4087-99c8-b6164de83299 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:15.898576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:15.899055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:15.899920 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:15.900410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:15.901693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c6431de2-0454-4087-99c8-b6164de83299 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:15.902146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c6431de2-0454-4087-99c8-b6164de83299 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:15.902978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c6431de2-0454-4087-99c8-b6164de83299 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:15.903422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c6431de2-0454-4087-99c8-b6164de83299 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:15.962991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:15.971404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:15.972875 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:15.974029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-aab3e5d0-866c-4fdd-8ea7-da4e00c93690 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090069 Feb 21 01:07:15.974588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 759/1701] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:16.035030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c6431de2-0454-4087-99c8-b6164de83299 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:16.047641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c6431de2-0454-4087-99c8-b6164de83299 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.157401 Feb 21 01:07:16.048630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 943/1702] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:15 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:16.748927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d15874d2-9492-4c34-975a-b7a04fd1b07c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:16.749971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d15874d2-9492-4c34-975a-b7a04fd1b07c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:16.758941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d15874d2-9492-4c34-975a-b7a04fd1b07c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:16.759538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d15874d2-9492-4c34-975a-b7a04fd1b07c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:16.760536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d15874d2-9492-4c34-975a-b7a04fd1b07c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:16.761073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d15874d2-9492-4c34-975a-b7a04fd1b07c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:16.913527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d15874d2-9492-4c34-975a-b7a04fd1b07c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:16.921372 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d15874d2-9492-4c34-975a-b7a04fd1b07c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.178767 Feb 21 01:07:16.921937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 760/1703] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:16 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:16.996058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:16.997135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:17.009215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:17.009954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:17.011291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:17.011990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:17.064777 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-52cf74ee-ca62-4de0-8d05-691316a3587f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:17.065381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-52cf74ee-ca62-4de0-8d05-691316a3587f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:17.071630 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52cf74ee-ca62-4de0-8d05-691316a3587f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:17.072035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52cf74ee-ca62-4de0-8d05-691316a3587f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:17.072876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52cf74ee-ca62-4de0-8d05-691316a3587f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:17.073293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52cf74ee-ca62-4de0-8d05-691316a3587f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:17.085107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:17.093671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:17.095182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:17.096326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-57036feb-e066-400b-bea3-c93e7e6b466a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.106642 Feb 21 01:07:17.096911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 944/1704] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:17.211477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-52cf74ee-ca62-4de0-8d05-691316a3587f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:17.223147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-52cf74ee-ca62-4de0-8d05-691316a3587f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.161864 Feb 21 01:07:17.223940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 761/1705] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:17 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:17.941263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e9e73e9b-53fc-463b-9ff0-7e46b5209791 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:17.942261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e9e73e9b-53fc-463b-9ff0-7e46b5209791 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:17.952363 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e9e73e9b-53fc-463b-9ff0-7e46b5209791 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:17.952839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e9e73e9b-53fc-463b-9ff0-7e46b5209791 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:17.953610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e9e73e9b-53fc-463b-9ff0-7e46b5209791 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:17.954035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e9e73e9b-53fc-463b-9ff0-7e46b5209791 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.096849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e9e73e9b-53fc-463b-9ff0-7e46b5209791 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:18.111286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e9e73e9b-53fc-463b-9ff0-7e46b5209791 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176091 Feb 21 01:07:18.111868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 945/1706] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:17 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:18.114399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:18.115004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:18.121504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.121940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.122711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.123132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.184454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:18.193058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:18.194478 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:18.195608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-da1d5e55-016f-4104-8477-19f7070c3391 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.084918 Feb 21 01:07:18.196161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 762/1707] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:07:18.239602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c3f72577-f08e-42b8-b7bf-0d772f1f788e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:18.240212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c3f72577-f08e-42b8-b7bf-0d772f1f788e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:18.246582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3f72577-f08e-42b8-b7bf-0d772f1f788e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.247032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3f72577-f08e-42b8-b7bf-0d772f1f788e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.247805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3f72577-f08e-42b8-b7bf-0d772f1f788e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.248236 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3f72577-f08e-42b8-b7bf-0d772f1f788e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.385013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c3f72577-f08e-42b8-b7bf-0d772f1f788e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:18.393288 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c3f72577-f08e-42b8-b7bf-0d772f1f788e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.157369 Feb 21 01:07:18.397591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 946/1708] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:18 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:18.603416 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:18.603937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:18.610092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.610545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.611321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.611761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.625122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] HTTP exception thrown: Instance 2482a368-86ed-4e3c-aa3d-e414ae527066 could not be found. Feb 21 01:07:18.625716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Returning 404 to user: Instance 2482a368-86ed-4e3c-aa3d-e414ae527066 could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:07:18.626570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-59e95b4d-cb57-4990-ba37-71fa15530a16 tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 404 len: 111 microversion: 2.1 time: 0.026919 Feb 21 01:07:18.627093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 763/1709] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:07:18 2022] DELETE /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:07:18.635028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:18.635649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] [instance: 2482a368-86ed-4e3c-aa3d-e414ae527066] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:18.642060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.642513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.643319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:18.643756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:18.657101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] HTTP exception thrown: Instance 2482a368-86ed-4e3c-aa3d-e414ae527066 could not be found. Feb 21 01:07:18.657681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] Returning 404 to user: Instance 2482a368-86ed-4e3c-aa3d-e414ae527066 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:07:18.658596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b96a6464-243a-44cf-b638-ba7f3c21751e tempest-AttachVolumeTestJSON-902074817 tempest-AttachVolumeTestJSON-902074817-project] 10.222.0.72 "GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066" status: 404 len: 111 microversion: 2.1 time: 0.027255 Feb 21 01:07:18.659108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 947/1710] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:18 2022] GET /compute/v2.1/servers/2482a368-86ed-4e3c-aa3d-e414ae527066 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:07:19.127887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-30d6a34e-cced-4ba4-a1ab-cfa2bb6289ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:19.128469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-30d6a34e-cced-4ba4-a1ab-cfa2bb6289ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:19.135006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-30d6a34e-cced-4ba4-a1ab-cfa2bb6289ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:19.135462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-30d6a34e-cced-4ba4-a1ab-cfa2bb6289ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:19.136258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-30d6a34e-cced-4ba4-a1ab-cfa2bb6289ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:19.136718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-30d6a34e-cced-4ba4-a1ab-cfa2bb6289ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:19.213553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:19.214205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:19.220850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:19.221297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:19.222075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:19.222507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:19.286737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:19.295195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:19.296840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:19.297970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-712ab2da-6a01-47fd-982c-c86dc3d37015 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088164 Feb 21 01:07:19.298494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 948/1711] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:19.369453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-30d6a34e-cced-4ba4-a1ab-cfa2bb6289ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:19.378106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-30d6a34e-cced-4ba4-a1ab-cfa2bb6289ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.254050 Feb 21 01:07:19.378603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 764/1712] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:19 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:19.410674 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5a9a7450-cca3-4749-8ccc-894c86f2c320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:19.411288 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5a9a7450-cca3-4749-8ccc-894c86f2c320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:19.417618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a9a7450-cca3-4749-8ccc-894c86f2c320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:19.418064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a9a7450-cca3-4749-8ccc-894c86f2c320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:19.418877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a9a7450-cca3-4749-8ccc-894c86f2c320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:19.419274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a9a7450-cca3-4749-8ccc-894c86f2c320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:19.552450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5a9a7450-cca3-4749-8ccc-894c86f2c320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:19.560423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5a9a7450-cca3-4749-8ccc-894c86f2c320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.153451 Feb 21 01:07:19.561004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 949/1713] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:19 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:20.315778 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:20.316434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:20.323448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:20.323940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:20.324773 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:20.325210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:20.395179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-46364396-79ec-41c1-8ceb-e2f10e1a3dfb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:20.396050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-46364396-79ec-41c1-8ceb-e2f10e1a3dfb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:20.403023 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46364396-79ec-41c1-8ceb-e2f10e1a3dfb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:20.403581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46364396-79ec-41c1-8ceb-e2f10e1a3dfb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:20.404491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46364396-79ec-41c1-8ceb-e2f10e1a3dfb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:20.404990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46364396-79ec-41c1-8ceb-e2f10e1a3dfb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:20.406364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:20.415165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:20.416848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:20.418097 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-19835788-4b13-4e6c-a0dc-d751c912bd4d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.106446 Feb 21 01:07:20.428549 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 765/1714] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:20.577375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-97f4101f-70fa-49c9-b8fb-4eb224ce7c05 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:20.577898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-97f4101f-70fa-49c9-b8fb-4eb224ce7c05 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:20.583846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97f4101f-70fa-49c9-b8fb-4eb224ce7c05 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:20.584289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97f4101f-70fa-49c9-b8fb-4eb224ce7c05 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:20.585092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97f4101f-70fa-49c9-b8fb-4eb224ce7c05 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:20.585704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97f4101f-70fa-49c9-b8fb-4eb224ce7c05 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:20.623450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-46364396-79ec-41c1-8ceb-e2f10e1a3dfb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:20.634754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-46364396-79ec-41c1-8ceb-e2f10e1a3dfb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.243310 Feb 21 01:07:20.635999 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 950/1715] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:20 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:20.723712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-97f4101f-70fa-49c9-b8fb-4eb224ce7c05 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:20.733843 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-97f4101f-70fa-49c9-b8fb-4eb224ce7c05 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.160088 Feb 21 01:07:20.734742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 766/1716] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:20 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:21.435279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:21.436040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:21.442869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:21.443305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:21.444084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:21.444543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:21.512208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:21.520685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:21.522182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:21.523706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3eebe6cf-30bd-42d1-90ad-3fd1f1e5dffb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092279 Feb 21 01:07:21.533711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 951/1717] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:21.651699 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9491421b-2ea9-47a4-a03c-a347185c781f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:21.652224 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9491421b-2ea9-47a4-a03c-a347185c781f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:21.659060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9491421b-2ea9-47a4-a03c-a347185c781f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:21.659543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9491421b-2ea9-47a4-a03c-a347185c781f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:21.660320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9491421b-2ea9-47a4-a03c-a347185c781f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:21.660790 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9491421b-2ea9-47a4-a03c-a347185c781f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:21.762975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-49ba63bf-fac7-4034-93b8-80549e78d4ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:21.769751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-49ba63bf-fac7-4034-93b8-80549e78d4ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:21.779952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-49ba63bf-fac7-4034-93b8-80549e78d4ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:21.780821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-49ba63bf-fac7-4034-93b8-80549e78d4ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:21.781936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-49ba63bf-fac7-4034-93b8-80549e78d4ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:21.782544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-49ba63bf-fac7-4034-93b8-80549e78d4ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:21.893590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9491421b-2ea9-47a4-a03c-a347185c781f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:21.904064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9491421b-2ea9-47a4-a03c-a347185c781f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.256408 Feb 21 01:07:21.906509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 767/1718] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:21 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:21.959823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-49ba63bf-fac7-4034-93b8-80549e78d4ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:21.968499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-49ba63bf-fac7-4034-93b8-80549e78d4ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.214444 Feb 21 01:07:21.969115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 952/1719] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:21 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:22.541368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:22.542019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:22.548117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:22.548617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:22.549448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:22.549878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:22.641585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:22.651752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:22.653378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:22.654409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-af56b191-ab67-4006-8861-24fc761a6f9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.116928 Feb 21 01:07:22.655084 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 768/1720] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:22.922199 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-18830bc3-a86d-415d-9ff2-126db553e33f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:22.922912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-18830bc3-a86d-415d-9ff2-126db553e33f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:22.929289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18830bc3-a86d-415d-9ff2-126db553e33f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:22.929741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18830bc3-a86d-415d-9ff2-126db553e33f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:22.930512 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18830bc3-a86d-415d-9ff2-126db553e33f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:22.930961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-18830bc3-a86d-415d-9ff2-126db553e33f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:22.985491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a5b3105b-5399-4ecf-a346-ed04099efdcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:22.986099 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a5b3105b-5399-4ecf-a346-ed04099efdcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:22.994239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5b3105b-5399-4ecf-a346-ed04099efdcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:22.997898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5b3105b-5399-4ecf-a346-ed04099efdcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:22.998707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5b3105b-5399-4ecf-a346-ed04099efdcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:22.999316 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a5b3105b-5399-4ecf-a346-ed04099efdcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:23.087865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-18830bc3-a86d-415d-9ff2-126db553e33f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:23.096377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-18830bc3-a86d-415d-9ff2-126db553e33f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.177991 Feb 21 01:07:23.096997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 953/1721] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:22 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:23.153096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a5b3105b-5399-4ecf-a346-ed04099efdcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:23.161118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a5b3105b-5399-4ecf-a346-ed04099efdcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.179501 Feb 21 01:07:23.161695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 769/1722] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:22 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:23.675381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:23.676108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:23.682267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:23.682735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:23.683517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:23.683945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:23.753340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:23.762096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:23.763649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:23.764993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-338551f5-9908-42ca-849f-f69c71a6d444 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093366 Feb 21 01:07:23.765561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 954/1723] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:24.113357 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1a8a4874-91a3-48b9-b0f5-2cc670aae9ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:24.113930 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1a8a4874-91a3-48b9-b0f5-2cc670aae9ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:24.120317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a8a4874-91a3-48b9-b0f5-2cc670aae9ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:24.120802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a8a4874-91a3-48b9-b0f5-2cc670aae9ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:24.121601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a8a4874-91a3-48b9-b0f5-2cc670aae9ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:24.122022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a8a4874-91a3-48b9-b0f5-2cc670aae9ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:24.179718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0a3746bf-b3f1-4d60-b0c2-525f198fe8d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:24.180331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0a3746bf-b3f1-4d60-b0c2-525f198fe8d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:24.187012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a3746bf-b3f1-4d60-b0c2-525f198fe8d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:24.187534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a3746bf-b3f1-4d60-b0c2-525f198fe8d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:24.188348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a3746bf-b3f1-4d60-b0c2-525f198fe8d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:24.188852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0a3746bf-b3f1-4d60-b0c2-525f198fe8d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:24.257257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a8a4874-91a3-48b9-b0f5-2cc670aae9ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:24.266936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1a8a4874-91a3-48b9-b0f5-2cc670aae9ee tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.155540 Feb 21 01:07:24.275958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 770/1724] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:24 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:24.333330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0a3746bf-b3f1-4d60-b0c2-525f198fe8d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:24.341237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0a3746bf-b3f1-4d60-b0c2-525f198fe8d9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.166512 Feb 21 01:07:24.341850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 955/1725] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:24 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:24.787028 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:24.788062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:24.797552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:24.797983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:24.798744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:24.799169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:24.863085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:24.871880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:24.873401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:24.874583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-04b0a6a8-3422-46b6-86ba-f15a742e04a7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093995 Feb 21 01:07:24.875140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 771/1726] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:25.288293 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-131fb087-25ab-40b4-ad5f-da75b8c374c8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:25.289266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-131fb087-25ab-40b4-ad5f-da75b8c374c8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:25.298621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-131fb087-25ab-40b4-ad5f-da75b8c374c8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:25.299064 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-131fb087-25ab-40b4-ad5f-da75b8c374c8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:25.299837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-131fb087-25ab-40b4-ad5f-da75b8c374c8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:25.300260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-131fb087-25ab-40b4-ad5f-da75b8c374c8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:25.360259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-adcdbdbf-bdb8-419c-88dc-60ec6d090670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:25.360877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-adcdbdbf-bdb8-419c-88dc-60ec6d090670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:25.367551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-adcdbdbf-bdb8-419c-88dc-60ec6d090670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:25.368000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-adcdbdbf-bdb8-419c-88dc-60ec6d090670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:25.368812 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-adcdbdbf-bdb8-419c-88dc-60ec6d090670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:25.369287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-adcdbdbf-bdb8-419c-88dc-60ec6d090670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:25.442077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-131fb087-25ab-40b4-ad5f-da75b8c374c8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:25.450812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-131fb087-25ab-40b4-ad5f-da75b8c374c8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168350 Feb 21 01:07:25.451350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 956/1727] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:25 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:25.500503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-adcdbdbf-bdb8-419c-88dc-60ec6d090670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:25.508587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-adcdbdbf-bdb8-419c-88dc-60ec6d090670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.153649 Feb 21 01:07:25.509156 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 772/1728] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:25 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:25.896536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:25.897521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:25.907237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:25.907678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:25.908520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:25.908943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:25.974411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:25.982794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:25.984424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:25.985551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-68d40b7c-22d6-4180-8864-f3767cb43be4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095377 Feb 21 01:07:25.986146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 957/1729] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:26.471698 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-89d4510a-4bae-468f-9765-40c26c26c508 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:26.472846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-89d4510a-4bae-468f-9765-40c26c26c508 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:26.483620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89d4510a-4bae-468f-9765-40c26c26c508 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:26.485032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89d4510a-4bae-468f-9765-40c26c26c508 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:26.487338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89d4510a-4bae-468f-9765-40c26c26c508 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:26.488726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-89d4510a-4bae-468f-9765-40c26c26c508 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:26.525880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f2b57cb4-9a1a-4c13-887c-c18442f45030 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:26.526487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f2b57cb4-9a1a-4c13-887c-c18442f45030 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:26.533217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2b57cb4-9a1a-4c13-887c-c18442f45030 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:26.533695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2b57cb4-9a1a-4c13-887c-c18442f45030 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:26.534476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2b57cb4-9a1a-4c13-887c-c18442f45030 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:26.534908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2b57cb4-9a1a-4c13-887c-c18442f45030 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:26.634623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-89d4510a-4bae-468f-9765-40c26c26c508 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:26.642557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-89d4510a-4bae-468f-9765-40c26c26c508 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.177287 Feb 21 01:07:26.643133 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 773/1730] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:26 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:26.666257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f2b57cb4-9a1a-4c13-887c-c18442f45030 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:26.674043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f2b57cb4-9a1a-4c13-887c-c18442f45030 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.152476 Feb 21 01:07:26.674608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 958/1731] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:26 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:27.007253 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:27.008265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:27.017444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:27.017891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:27.018673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:27.019111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:27.084256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:27.093995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:27.095475 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:27.096650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-691693ed-ca3e-421c-865d-43df6add0f71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095713 Feb 21 01:07:27.097205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 774/1732] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:27.663423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-338704e1-68b6-40c8-833e-a0475961a482 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:27.664470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-338704e1-68b6-40c8-833e-a0475961a482 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:27.674002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-338704e1-68b6-40c8-833e-a0475961a482 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:27.674445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-338704e1-68b6-40c8-833e-a0475961a482 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:27.675218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-338704e1-68b6-40c8-833e-a0475961a482 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:27.675640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-338704e1-68b6-40c8-833e-a0475961a482 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:27.691132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cc7bfbec-2e99-430f-a2e0-771e4e3db9eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:27.691957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cc7bfbec-2e99-430f-a2e0-771e4e3db9eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:27.698678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cc7bfbec-2e99-430f-a2e0-771e4e3db9eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:27.699123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cc7bfbec-2e99-430f-a2e0-771e4e3db9eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:27.699888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cc7bfbec-2e99-430f-a2e0-771e4e3db9eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:27.700315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cc7bfbec-2e99-430f-a2e0-771e4e3db9eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:27.809893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-338704e1-68b6-40c8-833e-a0475961a482 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:27.819809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-338704e1-68b6-40c8-833e-a0475961a482 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162493 Feb 21 01:07:27.820415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 959/1733] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:27 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:27.834587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cc7bfbec-2e99-430f-a2e0-771e4e3db9eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:27.842354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cc7bfbec-2e99-430f-a2e0-771e4e3db9eb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.155075 Feb 21 01:07:27.842890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 775/1734] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:27 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:28.118276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:28.119147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:28.127785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:28.128224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:28.129026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:28.129450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:28.196457 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:28.207475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:28.209006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:28.210232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bb7dc119-a5fa-4d14-a6bc-5753a79a8f95 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098624 Feb 21 01:07:28.210822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 960/1735] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:28.840735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b1224260-9646-4e9a-af9a-bcfa57e4c264 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:28.841673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b1224260-9646-4e9a-af9a-bcfa57e4c264 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:28.849459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1224260-9646-4e9a-af9a-bcfa57e4c264 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:28.849904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1224260-9646-4e9a-af9a-bcfa57e4c264 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:28.850696 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1224260-9646-4e9a-af9a-bcfa57e4c264 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:28.851123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b1224260-9646-4e9a-af9a-bcfa57e4c264 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:28.859139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bebfc1ef-ae8d-496a-8962-73fffc2232cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:28.859756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bebfc1ef-ae8d-496a-8962-73fffc2232cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:28.865929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bebfc1ef-ae8d-496a-8962-73fffc2232cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:28.866388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bebfc1ef-ae8d-496a-8962-73fffc2232cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:28.867164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bebfc1ef-ae8d-496a-8962-73fffc2232cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:28.867590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bebfc1ef-ae8d-496a-8962-73fffc2232cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:28.986955 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b1224260-9646-4e9a-af9a-bcfa57e4c264 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:28.995206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b1224260-9646-4e9a-af9a-bcfa57e4c264 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160777 Feb 21 01:07:28.995781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 776/1736] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:28 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:28.999271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bebfc1ef-ae8d-496a-8962-73fffc2232cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:29.007376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bebfc1ef-ae8d-496a-8962-73fffc2232cb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.151963 Feb 21 01:07:29.007948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 961/1737] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:28 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:29.227599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:29.228315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:29.235060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:29.235567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:29.236417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:29.236848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:29.302263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:29.310723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:29.312202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:29.313412 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-63e9a4dd-842a-43be-ba71-61589d1c4539 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089843 Feb 21 01:07:29.314060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 777/1738] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:30.015429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8cacf1c6-d22f-48c0-a3ec-811ff9bbc347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:30.016009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8cacf1c6-d22f-48c0-a3ec-811ff9bbc347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:30.023615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cacf1c6-d22f-48c0-a3ec-811ff9bbc347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:30.024048 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cacf1c6-d22f-48c0-a3ec-811ff9bbc347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:30.024547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dbf2d6b5-fb71-4c16-b8a2-1f36ec54bc5c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:30.025040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cacf1c6-d22f-48c0-a3ec-811ff9bbc347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:30.025159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dbf2d6b5-fb71-4c16-b8a2-1f36ec54bc5c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:30.025263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cacf1c6-d22f-48c0-a3ec-811ff9bbc347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:30.031773 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbf2d6b5-fb71-4c16-b8a2-1f36ec54bc5c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:30.032216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbf2d6b5-fb71-4c16-b8a2-1f36ec54bc5c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:30.033033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbf2d6b5-fb71-4c16-b8a2-1f36ec54bc5c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:30.033459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbf2d6b5-fb71-4c16-b8a2-1f36ec54bc5c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:30.156123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8cacf1c6-d22f-48c0-a3ec-811ff9bbc347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:30.163992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8cacf1c6-d22f-48c0-a3ec-811ff9bbc347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.154272 Feb 21 01:07:30.164624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 962/1739] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:30 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:30.166499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dbf2d6b5-fb71-4c16-b8a2-1f36ec54bc5c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:30.174278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dbf2d6b5-fb71-4c16-b8a2-1f36ec54bc5c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1600 microversion: 2.1 time: 0.153796 Feb 21 01:07:30.174909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 778/1740] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:30 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:30.334256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:30.334773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:30.343472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:30.344032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:30.345218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:30.345712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:30.415218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:30.424072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:30.425698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:30.426823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-066dcaa1-b8d5-4958-acdd-59fab2f62e24 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098020 Feb 21 01:07:30.427398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 963/1741] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:30.996288 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-b251a4b0-0253-4ae2-8a5c-6a841420d768 req-d6073c61-b4e3-4011-936d-1d1e603cef24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e018349-6a79-41ca-89e4-86d1bf355cd0", "name": "network-vif-deleted", "tag": "01160744-2091-4d9b-9585-581bf4da5aa7"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:07:30.998149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:07:30.998149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:07:31.006486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-b251a4b0-0253-4ae2-8a5c-6a841420d768 req-d6073c61-b4e3-4011-936d-1d1e603cef24 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:31.006918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-b251a4b0-0253-4ae2-8a5c-6a841420d768 req-d6073c61-b4e3-4011-936d-1d1e603cef24 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:31.017754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-b251a4b0-0253-4ae2-8a5c-6a841420d768 req-d6073c61-b4e3-4011-936d-1d1e603cef24 service nova] Creating event network-vif-deleted:01160744-2091-4d9b-9585-581bf4da5aa7 for instance 1e018349-6a79-41ca-89e4-86d1bf355cd0 on hv-cinder-81322 Feb 21 01:07:31.023140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-b251a4b0-0253-4ae2-8a5c-6a841420d768 req-d6073c61-b4e3-4011-936d-1d1e603cef24 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152245 Feb 21 01:07:31.023723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 779/1742] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:07:31.181515 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d651d0b2-c498-4198-9da3-3f6d3438b7ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:31.182139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d651d0b2-c498-4198-9da3-3f6d3438b7ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:31.189508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d651d0b2-c498-4198-9da3-3f6d3438b7ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:31.189961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d651d0b2-c498-4198-9da3-3f6d3438b7ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:31.190789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d651d0b2-c498-4198-9da3-3f6d3438b7ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:31.191223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d651d0b2-c498-4198-9da3-3f6d3438b7ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:31.196081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9a32d550-b0fd-4d6f-9619-a7c82977bdb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:31.196967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9a32d550-b0fd-4d6f-9619-a7c82977bdb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:31.203786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a32d550-b0fd-4d6f-9619-a7c82977bdb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:31.204243 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a32d550-b0fd-4d6f-9619-a7c82977bdb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:31.205164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a32d550-b0fd-4d6f-9619-a7c82977bdb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:31.205537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a32d550-b0fd-4d6f-9619-a7c82977bdb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:31.273471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9a32d550-b0fd-4d6f-9619-a7c82977bdb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:31.285825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9a32d550-b0fd-4d6f-9619-a7c82977bdb9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.098093 Feb 21 01:07:31.287230 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 780/1743] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:31 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:31.328342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d651d0b2-c498-4198-9da3-3f6d3438b7ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:31.336248 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d651d0b2-c498-4198-9da3-3f6d3438b7ab tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158862 Feb 21 01:07:31.336859 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 964/1744] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:31 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:31.452513 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:31.453400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:31.463575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:31.464222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:31.465590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:31.466299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:31.532578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:31.541268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:31.542748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:31.543941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a901f6e0-e0fc-4b56-ba24-969f7e0847a8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097917 Feb 21 01:07:31.544539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 781/1745] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:32.306480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a5ec808a-0c29-4b45-a295-4a933522f5b8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:32.307139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a5ec808a-0c29-4b45-a295-4a933522f5b8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:32.317273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5ec808a-0c29-4b45-a295-4a933522f5b8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:32.317716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5ec808a-0c29-4b45-a295-4a933522f5b8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:32.318497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5ec808a-0c29-4b45-a295-4a933522f5b8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:32.318921 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5ec808a-0c29-4b45-a295-4a933522f5b8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:32.353221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-12c45d61-6212-4e8a-af51-1f9bc6cd46ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:32.353846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-12c45d61-6212-4e8a-af51-1f9bc6cd46ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:32.360648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12c45d61-6212-4e8a-af51-1f9bc6cd46ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:32.361097 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12c45d61-6212-4e8a-af51-1f9bc6cd46ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:32.361884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12c45d61-6212-4e8a-af51-1f9bc6cd46ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:32.362337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12c45d61-6212-4e8a-af51-1f9bc6cd46ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:32.380521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a5ec808a-0c29-4b45-a295-4a933522f5b8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:32.388372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a5ec808a-0c29-4b45-a295-4a933522f5b8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088277 Feb 21 01:07:32.389062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 965/1746] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:32 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:32.497055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-12c45d61-6212-4e8a-af51-1f9bc6cd46ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:32.505620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-12c45d61-6212-4e8a-af51-1f9bc6cd46ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156074 Feb 21 01:07:32.506163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 782/1747] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:32 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:32.567956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:32.568536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:32.575317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:32.575758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:32.576568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:32.576992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:32.653869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:32.662183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:32.663646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:32.664802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-96f8b089-2add-454d-af7b-d46ce4220a83 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101999 Feb 21 01:07:32.665359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 966/1748] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:33.410148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d4ec5f3c-e5ac-4c13-9987-75fe0bcd350b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:33.411173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d4ec5f3c-e5ac-4c13-9987-75fe0bcd350b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:33.421872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d4ec5f3c-e5ac-4c13-9987-75fe0bcd350b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:33.422565 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d4ec5f3c-e5ac-4c13-9987-75fe0bcd350b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:33.423868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d4ec5f3c-e5ac-4c13-9987-75fe0bcd350b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:33.424634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d4ec5f3c-e5ac-4c13-9987-75fe0bcd350b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:33.484583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d4ec5f3c-e5ac-4c13-9987-75fe0bcd350b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:33.493104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d4ec5f3c-e5ac-4c13-9987-75fe0bcd350b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089075 Feb 21 01:07:33.493678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 783/1749] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:33 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:33.524994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fd12faa4-99c1-46ba-8fd8-68fc17ea87c3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:33.525673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fd12faa4-99c1-46ba-8fd8-68fc17ea87c3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:33.532866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd12faa4-99c1-46ba-8fd8-68fc17ea87c3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:33.533310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd12faa4-99c1-46ba-8fd8-68fc17ea87c3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:33.534119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd12faa4-99c1-46ba-8fd8-68fc17ea87c3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:33.534542 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fd12faa4-99c1-46ba-8fd8-68fc17ea87c3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:33.665100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fd12faa4-99c1-46ba-8fd8-68fc17ea87c3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:33.673297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fd12faa4-99c1-46ba-8fd8-68fc17ea87c3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.152562 Feb 21 01:07:33.673863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 967/1750] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:33 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:33.682624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:33.683625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:33.692620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:33.693293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:33.694128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:33.694566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:33.758091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:33.766740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:33.768239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:33.769412 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f7851315-4336-494c-9da5-4ac51dfbe7e6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090667 Feb 21 01:07:33.769973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 784/1751] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:34.510719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-604b33f6-d91d-4339-8de8-3b7216eda3f3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:34.511386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-604b33f6-d91d-4339-8de8-3b7216eda3f3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:34.518352 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-604b33f6-d91d-4339-8de8-3b7216eda3f3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:34.518840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-604b33f6-d91d-4339-8de8-3b7216eda3f3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:34.519753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-604b33f6-d91d-4339-8de8-3b7216eda3f3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:34.524473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-604b33f6-d91d-4339-8de8-3b7216eda3f3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:34.581699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-604b33f6-d91d-4339-8de8-3b7216eda3f3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:34.590503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-604b33f6-d91d-4339-8de8-3b7216eda3f3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.083948 Feb 21 01:07:34.591080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 968/1752] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:34 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:34.694091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7c306351-c61b-4fdc-a0a0-bde486c9195d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:34.695202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7c306351-c61b-4fdc-a0a0-bde486c9195d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:34.705768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c306351-c61b-4fdc-a0a0-bde486c9195d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:34.706499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c306351-c61b-4fdc-a0a0-bde486c9195d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:34.707765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c306351-c61b-4fdc-a0a0-bde486c9195d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:34.708515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7c306351-c61b-4fdc-a0a0-bde486c9195d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:34.787744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:34.788264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:34.794610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:34.795058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:34.795840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:34.796265 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:34.851769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7c306351-c61b-4fdc-a0a0-bde486c9195d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:34.855435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:34.859984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7c306351-c61b-4fdc-a0a0-bde486c9195d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172457 Feb 21 01:07:34.861299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 785/1753] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:34 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:34.863682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:34.865204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:34.866314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-900f9e66-48a4-4d5d-b07c-bcf30647f168 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.082957 Feb 21 01:07:34.866872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 969/1754] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:35.610985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b2819330-14b7-4818-9095-e0ad04dd44bc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:35.612043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b2819330-14b7-4818-9095-e0ad04dd44bc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:35.619225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2819330-14b7-4818-9095-e0ad04dd44bc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:35.619697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2819330-14b7-4818-9095-e0ad04dd44bc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:35.620537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2819330-14b7-4818-9095-e0ad04dd44bc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:35.620991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b2819330-14b7-4818-9095-e0ad04dd44bc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:35.690520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b2819330-14b7-4818-9095-e0ad04dd44bc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:35.699418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b2819330-14b7-4818-9095-e0ad04dd44bc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.094746 Feb 21 01:07:35.700068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 786/1755] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:35 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:35.881365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f4bb37bc-3f14-44de-a8d1-1b93ef1e6c31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:35.882413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f4bb37bc-3f14-44de-a8d1-1b93ef1e6c31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:35.887823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:35.888886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:35.892821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f4bb37bc-3f14-44de-a8d1-1b93ef1e6c31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:35.893555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f4bb37bc-3f14-44de-a8d1-1b93ef1e6c31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:35.894887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f4bb37bc-3f14-44de-a8d1-1b93ef1e6c31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:35.895330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f4bb37bc-3f14-44de-a8d1-1b93ef1e6c31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:35.897927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:35.898314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:35.899087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:35.899540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:35.962717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:35.971263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:35.972854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:35.974022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bdeb51a5-f1fa-4a4d-842f-81b128b5871b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092288 Feb 21 01:07:35.974579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 787/1756] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:35 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:36.029780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f4bb37bc-3f14-44de-a8d1-1b93ef1e6c31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:36.037756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f4bb37bc-3f14-44de-a8d1-1b93ef1e6c31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162468 Feb 21 01:07:36.038322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 970/1757] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:35 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:36.720485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6935a280-9a1a-4d99-962f-245050a12cf4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:36.721456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6935a280-9a1a-4d99-962f-245050a12cf4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:36.728526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6935a280-9a1a-4d99-962f-245050a12cf4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:36.728958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6935a280-9a1a-4d99-962f-245050a12cf4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:36.729721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6935a280-9a1a-4d99-962f-245050a12cf4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:36.730147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6935a280-9a1a-4d99-962f-245050a12cf4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:36.788646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6935a280-9a1a-4d99-962f-245050a12cf4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:36.796548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6935a280-9a1a-4d99-962f-245050a12cf4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082265 Feb 21 01:07:36.797143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 788/1758] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:36 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:36.995507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:36.996462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:37.006178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:37.006641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:37.007406 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:37.007826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:37.055219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9437da2c-88ca-4861-8114-5e0ba34757be tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:37.055830 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9437da2c-88ca-4861-8114-5e0ba34757be tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:37.062296 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9437da2c-88ca-4861-8114-5e0ba34757be tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:37.062811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9437da2c-88ca-4861-8114-5e0ba34757be tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:37.063656 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9437da2c-88ca-4861-8114-5e0ba34757be tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:37.064161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9437da2c-88ca-4861-8114-5e0ba34757be tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:37.068524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:37.076871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:37.078343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:37.079483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3d00324f-5685-4629-b1f0-dd41093fd498 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090177 Feb 21 01:07:37.080041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 971/1759] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:36 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:37.200188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9437da2c-88ca-4861-8114-5e0ba34757be tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:37.208439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9437da2c-88ca-4861-8114-5e0ba34757be tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157133 Feb 21 01:07:37.209027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 789/1760] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:37 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:37.822954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0572438a-c9f6-458b-b4fd-b38b5d94f086 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:37.823965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0572438a-c9f6-458b-b4fd-b38b5d94f086 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:37.833712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0572438a-c9f6-458b-b4fd-b38b5d94f086 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:37.834162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0572438a-c9f6-458b-b4fd-b38b5d94f086 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:37.834945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0572438a-c9f6-458b-b4fd-b38b5d94f086 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:37.835370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0572438a-c9f6-458b-b4fd-b38b5d94f086 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:37.896172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0572438a-c9f6-458b-b4fd-b38b5d94f086 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:37.904667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0572438a-c9f6-458b-b4fd-b38b5d94f086 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088099 Feb 21 01:07:37.905242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 972/1761] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:37 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:38.097724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:38.098274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:38.104992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:38.105429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:38.106207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:38.106643 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:38.167851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:38.176714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:38.178212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:38.179354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-80c56669-0920-4719-8766-7e30d1034fa0 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085640 Feb 21 01:07:38.179916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 790/1762] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:38.227897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8db48760-6729-416a-a71d-008ab6d7380e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:38.228870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8db48760-6729-416a-a71d-008ab6d7380e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:38.238873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8db48760-6729-416a-a71d-008ab6d7380e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:38.239551 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8db48760-6729-416a-a71d-008ab6d7380e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:38.240783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8db48760-6729-416a-a71d-008ab6d7380e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:38.241443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8db48760-6729-416a-a71d-008ab6d7380e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:38.386036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8db48760-6729-416a-a71d-008ab6d7380e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:38.396272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8db48760-6729-416a-a71d-008ab6d7380e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173767 Feb 21 01:07:38.396902 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 973/1763] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:38 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:38.925753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-eaef2601-7d8a-4384-9429-8c3661dbac49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:38.926760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-eaef2601-7d8a-4384-9429-8c3661dbac49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:38.937449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eaef2601-7d8a-4384-9429-8c3661dbac49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:38.938341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eaef2601-7d8a-4384-9429-8c3661dbac49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:38.939815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eaef2601-7d8a-4384-9429-8c3661dbac49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:38.940569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eaef2601-7d8a-4384-9429-8c3661dbac49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:39.005286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eaef2601-7d8a-4384-9429-8c3661dbac49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:39.013614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-eaef2601-7d8a-4384-9429-8c3661dbac49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.094279 Feb 21 01:07:39.014196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 791/1764] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:38 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:39.205556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:39.206437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:39.216461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:39.217198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:39.218462 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:39.219164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:39.284793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:39.293466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:39.294939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:39.296096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4c1e6485-ad21-4a4e-b017-cd8198b16943 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097081 Feb 21 01:07:39.296712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 974/1765] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:39.417349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bf77a9a6-23b0-403f-a51b-11d06ff943ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:39.418448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bf77a9a6-23b0-403f-a51b-11d06ff943ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:39.428030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bf77a9a6-23b0-403f-a51b-11d06ff943ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:39.428511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bf77a9a6-23b0-403f-a51b-11d06ff943ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:39.429311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bf77a9a6-23b0-403f-a51b-11d06ff943ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:39.429736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bf77a9a6-23b0-403f-a51b-11d06ff943ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:39.563839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bf77a9a6-23b0-403f-a51b-11d06ff943ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:39.571946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bf77a9a6-23b0-403f-a51b-11d06ff943ca tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160794 Feb 21 01:07:39.572526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 792/1766] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:39 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:40.034537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3472e860-6444-4c95-bb25-a74926cf0a2b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:40.035531 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3472e860-6444-4c95-bb25-a74926cf0a2b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:40.042087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3472e860-6444-4c95-bb25-a74926cf0a2b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:40.042525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3472e860-6444-4c95-bb25-a74926cf0a2b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:40.043293 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3472e860-6444-4c95-bb25-a74926cf0a2b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:40.043718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3472e860-6444-4c95-bb25-a74926cf0a2b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:40.105163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3472e860-6444-4c95-bb25-a74926cf0a2b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:40.113345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3472e860-6444-4c95-bb25-a74926cf0a2b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085018 Feb 21 01:07:40.114058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 975/1767] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:40 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:40.318264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:40.319153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:40.329369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:40.330115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:40.331416 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:40.332122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:40.395784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:40.404658 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:40.406137 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:40.407282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-90b8aba7-c0bf-45b0-82b4-7a69ebfb2ebb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095584 Feb 21 01:07:40.407842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 793/1768] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:40 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:40.592304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-90da34ef-321f-4161-8058-52df9e2cb2fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:40.593219 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-90da34ef-321f-4161-8058-52df9e2cb2fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:40.601878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90da34ef-321f-4161-8058-52df9e2cb2fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:40.602340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90da34ef-321f-4161-8058-52df9e2cb2fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:40.603113 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90da34ef-321f-4161-8058-52df9e2cb2fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:40.603537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-90da34ef-321f-4161-8058-52df9e2cb2fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:40.739076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-90da34ef-321f-4161-8058-52df9e2cb2fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:40.746927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-90da34ef-321f-4161-8058-52df9e2cb2fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160905 Feb 21 01:07:40.747501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 976/1769] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:40 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:41.134132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-81ef14d8-4adf-4793-82ff-cb6b771808a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:41.135130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-81ef14d8-4adf-4793-82ff-cb6b771808a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:41.145650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81ef14d8-4adf-4793-82ff-cb6b771808a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:41.146091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81ef14d8-4adf-4793-82ff-cb6b771808a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:41.146870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81ef14d8-4adf-4793-82ff-cb6b771808a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:41.147297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81ef14d8-4adf-4793-82ff-cb6b771808a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:41.218393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-81ef14d8-4adf-4793-82ff-cb6b771808a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:41.226932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-81ef14d8-4adf-4793-82ff-cb6b771808a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.098956 Feb 21 01:07:41.227492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 794/1770] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:41 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:41.428767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:41.429683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:41.439938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:41.440743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:41.442085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:41.442508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:41.502275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:41.511190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:41.512691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:41.513799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f1cd949e-702c-4a86-89f5-4da90a417835 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091401 Feb 21 01:07:41.514373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 977/1771] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:41 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:41.765279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-290758f9-bfc1-4bd9-8400-da4caf7016c1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:41.766023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-290758f9-bfc1-4bd9-8400-da4caf7016c1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:41.773555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-290758f9-bfc1-4bd9-8400-da4caf7016c1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:41.773996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-290758f9-bfc1-4bd9-8400-da4caf7016c1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:41.774771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-290758f9-bfc1-4bd9-8400-da4caf7016c1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:41.775228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-290758f9-bfc1-4bd9-8400-da4caf7016c1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:41.920042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-290758f9-bfc1-4bd9-8400-da4caf7016c1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:41.932861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-290758f9-bfc1-4bd9-8400-da4caf7016c1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171606 Feb 21 01:07:41.933660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 795/1772] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:41 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:42.247399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7f9c6a3f-ccd4-489d-9287-516d0466f766 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:42.248020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7f9c6a3f-ccd4-489d-9287-516d0466f766 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:42.256768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f9c6a3f-ccd4-489d-9287-516d0466f766 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:42.257207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f9c6a3f-ccd4-489d-9287-516d0466f766 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:42.257973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f9c6a3f-ccd4-489d-9287-516d0466f766 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:42.258397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f9c6a3f-ccd4-489d-9287-516d0466f766 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:42.322518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7f9c6a3f-ccd4-489d-9287-516d0466f766 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:42.330719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7f9c6a3f-ccd4-489d-9287-516d0466f766 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089452 Feb 21 01:07:42.331326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 978/1773] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:42 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:42.536289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:42.537363 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:42.547984 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:42.548865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:42.550159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:42.550866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:42.620840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:42.629745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:42.631289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:42.632413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d3e68591-6761-43b7-afd4-6fe919f4bc17 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102547 Feb 21 01:07:42.633008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 796/1774] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:42.956776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-20524665-53a0-4fe3-b6a0-7c602a4884b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:42.957916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-20524665-53a0-4fe3-b6a0-7c602a4884b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:42.968095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-20524665-53a0-4fe3-b6a0-7c602a4884b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:42.968839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-20524665-53a0-4fe3-b6a0-7c602a4884b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:42.970079 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-20524665-53a0-4fe3-b6a0-7c602a4884b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:42.970792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-20524665-53a0-4fe3-b6a0-7c602a4884b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:43.106752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-20524665-53a0-4fe3-b6a0-7c602a4884b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:43.114812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-20524665-53a0-4fe3-b6a0-7c602a4884b2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164636 Feb 21 01:07:43.115601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 979/1775] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:42 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:43.351503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0cf9e345-aa06-4dcb-9205-e0cb3fda24bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:43.352635 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0cf9e345-aa06-4dcb-9205-e0cb3fda24bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:43.362689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0cf9e345-aa06-4dcb-9205-e0cb3fda24bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:43.363618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0cf9e345-aa06-4dcb-9205-e0cb3fda24bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:43.364573 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0cf9e345-aa06-4dcb-9205-e0cb3fda24bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:43.365008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0cf9e345-aa06-4dcb-9205-e0cb3fda24bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:43.426954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0cf9e345-aa06-4dcb-9205-e0cb3fda24bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:43.439208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0cf9e345-aa06-4dcb-9205-e0cb3fda24bd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093665 Feb 21 01:07:43.439997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 797/1776] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:43 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:43.654939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:43.655760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:43.664272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:43.664702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:43.665466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:43.665884 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:43.725846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:43.734239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:43.735774 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:43.736947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8998be8a-a1d9-4207-857e-8e327c9fddee tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088623 Feb 21 01:07:43.737504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 980/1777] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:44.135976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d5264552-01ce-497f-a0a7-5f26645ed1bc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:44.136942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d5264552-01ce-497f-a0a7-5f26645ed1bc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:44.146890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5264552-01ce-497f-a0a7-5f26645ed1bc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:44.147639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5264552-01ce-497f-a0a7-5f26645ed1bc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:44.148507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5264552-01ce-497f-a0a7-5f26645ed1bc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:44.148894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5264552-01ce-497f-a0a7-5f26645ed1bc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:44.308122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d5264552-01ce-497f-a0a7-5f26645ed1bc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:44.319041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d5264552-01ce-497f-a0a7-5f26645ed1bc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.189260 Feb 21 01:07:44.319588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 798/1778] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:44 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:44.465073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ebf8dcac-b1f7-4f6a-b803-130c434c9133 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:44.466028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ebf8dcac-b1f7-4f6a-b803-130c434c9133 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:44.475037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ebf8dcac-b1f7-4f6a-b803-130c434c9133 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:44.475600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ebf8dcac-b1f7-4f6a-b803-130c434c9133 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:44.476402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ebf8dcac-b1f7-4f6a-b803-130c434c9133 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:44.476830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ebf8dcac-b1f7-4f6a-b803-130c434c9133 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:44.535718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ebf8dcac-b1f7-4f6a-b803-130c434c9133 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:44.544205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ebf8dcac-b1f7-4f6a-b803-130c434c9133 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085531 Feb 21 01:07:44.544814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 981/1779] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:44 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:44.758460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:44.759462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:44.770034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:44.770480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:44.771254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:44.771681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:44.842354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:44.851435 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:44.852974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:44.854105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-25e265ea-022b-4c81-b83c-dba3b9907c84 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101924 Feb 21 01:07:44.854677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 799/1780] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:44 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:45.349830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-190f0ed5-fc29-4cfd-9e4d-66ef4d896462 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:45.350879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-190f0ed5-fc29-4cfd-9e4d-66ef4d896462 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:45.361618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-190f0ed5-fc29-4cfd-9e4d-66ef4d896462 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:45.362356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-190f0ed5-fc29-4cfd-9e4d-66ef4d896462 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:45.363625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-190f0ed5-fc29-4cfd-9e4d-66ef4d896462 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:45.364490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-190f0ed5-fc29-4cfd-9e4d-66ef4d896462 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:45.518847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-190f0ed5-fc29-4cfd-9e4d-66ef4d896462 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:45.527528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-190f0ed5-fc29-4cfd-9e4d-66ef4d896462 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.193067 Feb 21 01:07:45.528111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 982/1781] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:45 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:45.560681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5528c469-fc4c-4d7c-9c1f-b46f28d5f2f0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:45.561261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5528c469-fc4c-4d7c-9c1f-b46f28d5f2f0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:45.567811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5528c469-fc4c-4d7c-9c1f-b46f28d5f2f0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:45.568271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5528c469-fc4c-4d7c-9c1f-b46f28d5f2f0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:45.569110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5528c469-fc4c-4d7c-9c1f-b46f28d5f2f0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:45.569537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5528c469-fc4c-4d7c-9c1f-b46f28d5f2f0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:45.640458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5528c469-fc4c-4d7c-9c1f-b46f28d5f2f0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:45.649705 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5528c469-fc4c-4d7c-9c1f-b46f28d5f2f0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093082 Feb 21 01:07:45.650289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 800/1782] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:45 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:45.875945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:45.876986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:45.884807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:45.885107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:45.885863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:45.886290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:45.953841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:45.962686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:45.964153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:45.965340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f5ee0bc8-f141-42ca-8972-b086fcfc3b80 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095744 Feb 21 01:07:45.965927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 983/1783] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:45 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:46.544928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-721829ef-5f70-4186-a295-241e522322fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:46.545538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-721829ef-5f70-4186-a295-241e522322fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:46.551974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-721829ef-5f70-4186-a295-241e522322fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:46.552487 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-721829ef-5f70-4186-a295-241e522322fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:46.553264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-721829ef-5f70-4186-a295-241e522322fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:46.553694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-721829ef-5f70-4186-a295-241e522322fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:46.666619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5a85bce1-ce7e-4be0-aab0-4594666971d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:46.667230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5a85bce1-ce7e-4be0-aab0-4594666971d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:46.673634 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a85bce1-ce7e-4be0-aab0-4594666971d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:46.674083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a85bce1-ce7e-4be0-aab0-4594666971d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:46.674854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a85bce1-ce7e-4be0-aab0-4594666971d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:46.675285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a85bce1-ce7e-4be0-aab0-4594666971d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:46.697638 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-721829ef-5f70-4186-a295-241e522322fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:46.706057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-721829ef-5f70-4186-a295-241e522322fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164863 Feb 21 01:07:46.706641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 801/1784] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:46 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:46.734629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5a85bce1-ce7e-4be0-aab0-4594666971d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:46.742780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5a85bce1-ce7e-4be0-aab0-4594666971d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.079893 Feb 21 01:07:46.743356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 984/1785] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:46 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:46.987314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:46.988328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:46.995471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:46.995912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:46.996724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:46.997152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:47.066274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:47.074571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:47.076046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:47.077236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-42d0ceb3-0b29-466e-b931-1d32f0090a0e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096264 Feb 21 01:07:47.077796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 802/1786] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:47.726979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-be45b839-56a3-4783-9f49-b59b47f376bf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:47.728046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-be45b839-56a3-4783-9f49-b59b47f376bf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:47.738569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-be45b839-56a3-4783-9f49-b59b47f376bf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:47.739344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-be45b839-56a3-4783-9f49-b59b47f376bf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:47.740180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-be45b839-56a3-4783-9f49-b59b47f376bf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:47.740577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-be45b839-56a3-4783-9f49-b59b47f376bf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:47.759686 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-38f84a16-82ed-4605-8053-aed7ed3873a2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:47.760298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-38f84a16-82ed-4605-8053-aed7ed3873a2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:47.766913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38f84a16-82ed-4605-8053-aed7ed3873a2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:47.767349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38f84a16-82ed-4605-8053-aed7ed3873a2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:47.768128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38f84a16-82ed-4605-8053-aed7ed3873a2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:47.768598 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-38f84a16-82ed-4605-8053-aed7ed3873a2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:47.828166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-38f84a16-82ed-4605-8053-aed7ed3873a2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:47.836133 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-38f84a16-82ed-4605-8053-aed7ed3873a2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.080165 Feb 21 01:07:47.837030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 803/1787] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:47 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:47.874255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-be45b839-56a3-4783-9f49-b59b47f376bf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:47.882114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-be45b839-56a3-4783-9f49-b59b47f376bf tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.161397 Feb 21 01:07:47.882683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 985/1788] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:47 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:48.098941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:48.099632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:48.107825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:48.108446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:48.109465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:48.110028 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:48.184204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:48.192884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:48.194368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:48.195566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-064ff2ba-5175-4483-a9e1-e45ad57c047a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103035 Feb 21 01:07:48.196130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 804/1789] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:48.857516 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-30148f8e-62eb-425d-954d-4c5561754342 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:48.858426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-30148f8e-62eb-425d-954d-4c5561754342 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:48.869010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30148f8e-62eb-425d-954d-4c5561754342 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:48.869734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30148f8e-62eb-425d-954d-4c5561754342 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:48.870990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30148f8e-62eb-425d-954d-4c5561754342 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:48.871691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30148f8e-62eb-425d-954d-4c5561754342 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:48.900645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d926a7c7-f0e4-4e74-8e9d-c17f6038d5cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:48.901237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d926a7c7-f0e4-4e74-8e9d-c17f6038d5cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:48.908006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d926a7c7-f0e4-4e74-8e9d-c17f6038d5cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:48.908474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d926a7c7-f0e4-4e74-8e9d-c17f6038d5cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:48.909249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d926a7c7-f0e4-4e74-8e9d-c17f6038d5cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:48.909673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d926a7c7-f0e4-4e74-8e9d-c17f6038d5cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:48.936761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-30148f8e-62eb-425d-954d-4c5561754342 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:48.945222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-30148f8e-62eb-425d-954d-4c5561754342 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093985 Feb 21 01:07:48.945805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 986/1790] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:48 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:49.045280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d926a7c7-f0e4-4e74-8e9d-c17f6038d5cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:49.053313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d926a7c7-f0e4-4e74-8e9d-c17f6038d5cc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156741 Feb 21 01:07:49.053851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 805/1791] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:48 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:49.218118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:49.218970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:49.229114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:49.229841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:49.231098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:49.231804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:49.296922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:49.307139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:49.308645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:49.309768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9853872d-e15c-408c-b405-9b3912e56d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098558 Feb 21 01:07:49.310318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 987/1792] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:49.966769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ce8337b0-f14c-4170-a491-e5080b4d2cd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:49.967608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ce8337b0-f14c-4170-a491-e5080b4d2cd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:49.978258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce8337b0-f14c-4170-a491-e5080b4d2cd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:49.979005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce8337b0-f14c-4170-a491-e5080b4d2cd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:49.980277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce8337b0-f14c-4170-a491-e5080b4d2cd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:49.981048 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce8337b0-f14c-4170-a491-e5080b4d2cd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:50.045291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ce8337b0-f14c-4170-a491-e5080b4d2cd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:50.055499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ce8337b0-f14c-4170-a491-e5080b4d2cd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095196 Feb 21 01:07:50.056037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 806/1793] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:49 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:50.070469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-155c1974-145a-444a-aefa-1229a836ccbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:50.071106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-155c1974-145a-444a-aefa-1229a836ccbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:50.077794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-155c1974-145a-444a-aefa-1229a836ccbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:50.078235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-155c1974-145a-444a-aefa-1229a836ccbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:50.079006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-155c1974-145a-444a-aefa-1229a836ccbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:50.079431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-155c1974-145a-444a-aefa-1229a836ccbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:50.220274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-155c1974-145a-444a-aefa-1229a836ccbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:50.228777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-155c1974-145a-444a-aefa-1229a836ccbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162094 Feb 21 01:07:50.229349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 988/1794] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:50 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:50.330924 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:50.331934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:50.342123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:50.342865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:50.344154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:50.344969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:50.406676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:50.415197 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:50.416730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:50.417870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0f7e5071-f66f-464d-a826-6e225d566d87 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093333 Feb 21 01:07:50.418440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 807/1795] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:50 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:51.076121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0ef01dc9-6255-405a-adf6-6974e6fb44a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:51.076784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0ef01dc9-6255-405a-adf6-6974e6fb44a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:51.086699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0ef01dc9-6255-405a-adf6-6974e6fb44a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:51.087245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0ef01dc9-6255-405a-adf6-6974e6fb44a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:51.088472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0ef01dc9-6255-405a-adf6-6974e6fb44a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:51.089054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0ef01dc9-6255-405a-adf6-6974e6fb44a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:51.151425 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0ef01dc9-6255-405a-adf6-6974e6fb44a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:51.159666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0ef01dc9-6255-405a-adf6-6974e6fb44a8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089522 Feb 21 01:07:51.160240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 989/1796] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:51 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:51.249504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-42689949-c99b-44e1-8ab5-c70dafe394e8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:51.250515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-42689949-c99b-44e1-8ab5-c70dafe394e8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:51.259571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42689949-c99b-44e1-8ab5-c70dafe394e8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:51.260007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42689949-c99b-44e1-8ab5-c70dafe394e8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:51.260809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42689949-c99b-44e1-8ab5-c70dafe394e8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:51.261238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-42689949-c99b-44e1-8ab5-c70dafe394e8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:51.411459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-42689949-c99b-44e1-8ab5-c70dafe394e8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:51.423314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-42689949-c99b-44e1-8ab5-c70dafe394e8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.179675 Feb 21 01:07:51.423990 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 808/1797] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:51 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:51.435011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:51.435654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:51.442025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:51.442465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:51.443222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:51.443646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:51.506238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:51.514640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:51.516146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:51.517286 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-271d7f76-7421-4d3c-9b1e-5d2eb24c1dd8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086058 Feb 21 01:07:51.517807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 990/1798] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:51 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:52.177117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0ce1551f-1451-434d-8b58-cdc91224beb7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:52.177839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0ce1551f-1451-434d-8b58-cdc91224beb7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:52.184379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0ce1551f-1451-434d-8b58-cdc91224beb7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:52.184861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0ce1551f-1451-434d-8b58-cdc91224beb7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:52.185640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0ce1551f-1451-434d-8b58-cdc91224beb7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:52.186074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0ce1551f-1451-434d-8b58-cdc91224beb7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:52.246685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0ce1551f-1451-434d-8b58-cdc91224beb7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:52.255039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0ce1551f-1451-434d-8b58-cdc91224beb7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081733 Feb 21 01:07:52.255668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 809/1799] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:52 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:52.444910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-10efc4d7-da0a-47b5-985d-737750092025 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:52.445498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-10efc4d7-da0a-47b5-985d-737750092025 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:52.452848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-10efc4d7-da0a-47b5-985d-737750092025 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:52.453310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-10efc4d7-da0a-47b5-985d-737750092025 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:52.454109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-10efc4d7-da0a-47b5-985d-737750092025 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:52.454555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-10efc4d7-da0a-47b5-985d-737750092025 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:52.535501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:52.536269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:52.543358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:52.543792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:52.544634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:52.545069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:52.591650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-10efc4d7-da0a-47b5-985d-737750092025 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:52.599885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-10efc4d7-da0a-47b5-985d-737750092025 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160626 Feb 21 01:07:52.600448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 991/1800] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:52 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:52.606746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:52.615237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:52.616709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:52.617862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-898fbbb1-4187-4bfc-ac6e-c6f6ac72ec12 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086379 Feb 21 01:07:52.618410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 810/1801] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:07:53.275629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fda48521-4d93-4770-a2eb-6098687b400e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:53.276660 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fda48521-4d93-4770-a2eb-6098687b400e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:53.286596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fda48521-4d93-4770-a2eb-6098687b400e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:53.287306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fda48521-4d93-4770-a2eb-6098687b400e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:53.288082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fda48521-4d93-4770-a2eb-6098687b400e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:53.288541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fda48521-4d93-4770-a2eb-6098687b400e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:53.355140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fda48521-4d93-4770-a2eb-6098687b400e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:53.363678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fda48521-4d93-4770-a2eb-6098687b400e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.094508 Feb 21 01:07:53.364243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 992/1802] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:53 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:53.619051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e9650991-80bd-4db2-90b6-0bf6201ee7e2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:53.619669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e9650991-80bd-4db2-90b6-0bf6201ee7e2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:53.626743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e9650991-80bd-4db2-90b6-0bf6201ee7e2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:53.627188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e9650991-80bd-4db2-90b6-0bf6201ee7e2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:53.627944 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e9650991-80bd-4db2-90b6-0bf6201ee7e2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:53.628366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e9650991-80bd-4db2-90b6-0bf6201ee7e2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:53.635145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:53.636377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:53.642812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:53.643260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:53.644141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:53.644479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:53.706831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:53.715157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:53.716755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:53.717922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-40e15d46-df51-42c0-a357-aeeace8fe912 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086594 Feb 21 01:07:53.718491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 993/1803] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:53 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:53.763469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e9650991-80bd-4db2-90b6-0bf6201ee7e2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:53.771606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e9650991-80bd-4db2-90b6-0bf6201ee7e2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156586 Feb 21 01:07:53.772474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 811/1804] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:53 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:54.384162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-353eeefe-a17c-4810-a545-5d2f7cdc3b2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:54.385318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-353eeefe-a17c-4810-a545-5d2f7cdc3b2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:54.395654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-353eeefe-a17c-4810-a545-5d2f7cdc3b2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:54.396436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-353eeefe-a17c-4810-a545-5d2f7cdc3b2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:54.398012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-353eeefe-a17c-4810-a545-5d2f7cdc3b2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:54.398445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-353eeefe-a17c-4810-a545-5d2f7cdc3b2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:54.464079 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-353eeefe-a17c-4810-a545-5d2f7cdc3b2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:54.479007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-353eeefe-a17c-4810-a545-5d2f7cdc3b2c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.100664 Feb 21 01:07:54.479986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 994/1805] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:54 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:54.739461 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:54.740485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:54.751261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:54.752011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:54.753364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:54.754089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:54.788056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eeee402e-2373-4220-8613-9a0f8b02d88c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:54.788765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eeee402e-2373-4220-8613-9a0f8b02d88c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:54.795249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eeee402e-2373-4220-8613-9a0f8b02d88c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:54.795686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eeee402e-2373-4220-8613-9a0f8b02d88c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:54.796479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eeee402e-2373-4220-8613-9a0f8b02d88c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:54.796907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eeee402e-2373-4220-8613-9a0f8b02d88c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:54.817508 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:54.827386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:54.829155 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:54.830404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-90cbedd5-45bc-4db3-8c9d-a97d93079ff1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097219 Feb 21 01:07:54.831204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 812/1806] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:54 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:55.101160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eeee402e-2373-4220-8613-9a0f8b02d88c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:55.109299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eeee402e-2373-4220-8613-9a0f8b02d88c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.325048 Feb 21 01:07:55.109854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 995/1807] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:54 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:55.504914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0ae682e9-832c-4a23-9b38-31096b92baa5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:55.505704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0ae682e9-832c-4a23-9b38-31096b92baa5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:55.512675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0ae682e9-832c-4a23-9b38-31096b92baa5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:55.513128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0ae682e9-832c-4a23-9b38-31096b92baa5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:55.513935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0ae682e9-832c-4a23-9b38-31096b92baa5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:55.514359 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0ae682e9-832c-4a23-9b38-31096b92baa5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:55.574747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0ae682e9-832c-4a23-9b38-31096b92baa5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:55.582713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0ae682e9-832c-4a23-9b38-31096b92baa5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082633 Feb 21 01:07:55.583246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 813/1808] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:55 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:55.852713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:55.853606 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:55.864440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:55.865186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:55.866502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:55.866929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:55.926701 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:55.935616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:55.937136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:55.938327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5ac8dfda-7d38-4448-85db-e99a75be626b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092001 Feb 21 01:07:55.938882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 996/1809] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:56.130893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b872855f-94ca-4f90-9cb6-575e568ffa45 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:56.131787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b872855f-94ca-4f90-9cb6-575e568ffa45 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:56.138805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b872855f-94ca-4f90-9cb6-575e568ffa45 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:56.139250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b872855f-94ca-4f90-9cb6-575e568ffa45 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:56.140134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b872855f-94ca-4f90-9cb6-575e568ffa45 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:56.140622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b872855f-94ca-4f90-9cb6-575e568ffa45 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:56.280946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b872855f-94ca-4f90-9cb6-575e568ffa45 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:56.291154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b872855f-94ca-4f90-9cb6-575e568ffa45 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166765 Feb 21 01:07:56.291768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 814/1810] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:56 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:56.607740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-06557865-f940-4096-823a-2da5f622ec19 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:56.608531 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-06557865-f940-4096-823a-2da5f622ec19 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:56.617276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06557865-f940-4096-823a-2da5f622ec19 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:56.617719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06557865-f940-4096-823a-2da5f622ec19 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:56.618493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06557865-f940-4096-823a-2da5f622ec19 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:56.618918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-06557865-f940-4096-823a-2da5f622ec19 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:56.690993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-06557865-f940-4096-823a-2da5f622ec19 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:56.699485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-06557865-f940-4096-823a-2da5f622ec19 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.097344 Feb 21 01:07:56.700038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 997/1811] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:56 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:56.965737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:56.966625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:56.976537 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:56.976973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:56.977743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:56.978173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:57.046692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:57.055127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:57.056668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:57.057845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bb289df7-d135-4a35-af3a-7baceb941070 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098981 Feb 21 01:07:57.058632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 815/1812] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:56 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:57.312066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-647e8c8a-6fac-445a-a29d-6c57354ef1fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:57.313118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-647e8c8a-6fac-445a-a29d-6c57354ef1fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:57.323890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-647e8c8a-6fac-445a-a29d-6c57354ef1fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:57.324697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-647e8c8a-6fac-445a-a29d-6c57354ef1fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:57.326481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-647e8c8a-6fac-445a-a29d-6c57354ef1fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:57.327760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-647e8c8a-6fac-445a-a29d-6c57354ef1fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:57.470790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-647e8c8a-6fac-445a-a29d-6c57354ef1fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:57.483279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-647e8c8a-6fac-445a-a29d-6c57354ef1fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.177276 Feb 21 01:07:57.484100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 998/1813] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:57 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:57.720147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8e4946a7-f177-450b-9831-50db87a2d36c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:57.721058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8e4946a7-f177-450b-9831-50db87a2d36c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:57.729417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e4946a7-f177-450b-9831-50db87a2d36c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:57.729856 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e4946a7-f177-450b-9831-50db87a2d36c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:57.730633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e4946a7-f177-450b-9831-50db87a2d36c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:57.731061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8e4946a7-f177-450b-9831-50db87a2d36c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:57.791989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8e4946a7-f177-450b-9831-50db87a2d36c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:57.799947 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8e4946a7-f177-450b-9831-50db87a2d36c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086110 Feb 21 01:07:57.800542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 816/1814] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:57 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:58.079378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:58.080441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:58.088642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:58.089086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:58.089887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:58.090313 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:58.150091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:58.158729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:58.160191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:58.161421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6dc77fd0-96e1-445c-9511-06f4a8739a49 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088275 Feb 21 01:07:58.161958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 999/1815] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:58.508603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1c211d1f-e435-485b-921c-c8e8f6048dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:58.509850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1c211d1f-e435-485b-921c-c8e8f6048dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:58.519635 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c211d1f-e435-485b-921c-c8e8f6048dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:58.520204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c211d1f-e435-485b-921c-c8e8f6048dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:58.521220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c211d1f-e435-485b-921c-c8e8f6048dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:58.521767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1c211d1f-e435-485b-921c-c8e8f6048dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:58.669585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1c211d1f-e435-485b-921c-c8e8f6048dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:58.681971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1c211d1f-e435-485b-921c-c8e8f6048dd3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.179900 Feb 21 01:07:58.682728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 817/1816] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:58 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:58.821501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-22d7e8bc-91b6-44e2-aa3d-d97a79805987 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:58.822476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-22d7e8bc-91b6-44e2-aa3d-d97a79805987 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:58.832704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22d7e8bc-91b6-44e2-aa3d-d97a79805987 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:58.833423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22d7e8bc-91b6-44e2-aa3d-d97a79805987 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:58.834720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22d7e8bc-91b6-44e2-aa3d-d97a79805987 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:58.835500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22d7e8bc-91b6-44e2-aa3d-d97a79805987 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:58.894008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-22d7e8bc-91b6-44e2-aa3d-d97a79805987 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:58.902408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-22d7e8bc-91b6-44e2-aa3d-d97a79805987 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.087201 Feb 21 01:07:58.902962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1000/1817] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:58 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:59.187198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:59.188254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:59.197369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:59.197811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:59.198586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:59.199009 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:59.259861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:59.269110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:59.270603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:59.271793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3157622b-2fc4-4efc-97db-1596e4b118c7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090831 Feb 21 01:07:59.272724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 818/1818] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:07:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:07:59.707536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4c5dcf45-ec04-4596-98a4-609a7d929f5e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:59.708613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4c5dcf45-ec04-4596-98a4-609a7d929f5e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:59.716332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c5dcf45-ec04-4596-98a4-609a7d929f5e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:59.716808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c5dcf45-ec04-4596-98a4-609a7d929f5e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:59.717584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c5dcf45-ec04-4596-98a4-609a7d929f5e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:59.718020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c5dcf45-ec04-4596-98a4-609a7d929f5e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:59.868864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4c5dcf45-ec04-4596-98a4-609a7d929f5e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:59.877170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4c5dcf45-ec04-4596-98a4-609a7d929f5e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.175901 Feb 21 01:07:59.877724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1001/1819] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:59 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:07:59.919393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9994de8c-0f72-4735-9b2b-9b741929d7a7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:07:59.920112 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9994de8c-0f72-4735-9b2b-9b741929d7a7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:07:59.926837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9994de8c-0f72-4735-9b2b-9b741929d7a7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:59.927302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9994de8c-0f72-4735-9b2b-9b741929d7a7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:59.928063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9994de8c-0f72-4735-9b2b-9b741929d7a7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:07:59.928520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9994de8c-0f72-4735-9b2b-9b741929d7a7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:07:59.988439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9994de8c-0f72-4735-9b2b-9b741929d7a7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:07:59.997066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9994de8c-0f72-4735-9b2b-9b741929d7a7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081369 Feb 21 01:07:59.997636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 819/1820] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:07:59 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:00.292471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:00.294005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:00.304235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:00.304718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:00.305505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:00.305925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:00.376695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:00.389368 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:00.391495 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:00.392889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eacab53a-1294-49e2-b593-0505704a905c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.105391 Feb 21 01:08:00.393621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1002/1821] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:00 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:00.899032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a30273b0-ecc3-4769-94c7-5da894f73861 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:00.899954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a30273b0-ecc3-4769-94c7-5da894f73861 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:00.910204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a30273b0-ecc3-4769-94c7-5da894f73861 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:00.910946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a30273b0-ecc3-4769-94c7-5da894f73861 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:00.912212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a30273b0-ecc3-4769-94c7-5da894f73861 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:00.913017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a30273b0-ecc3-4769-94c7-5da894f73861 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:01.013387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5af8a93b-73e0-44ef-87f5-b2bb4d7767f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:01.014002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5af8a93b-73e0-44ef-87f5-b2bb4d7767f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:01.020432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5af8a93b-73e0-44ef-87f5-b2bb4d7767f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:01.020885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5af8a93b-73e0-44ef-87f5-b2bb4d7767f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:01.021662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5af8a93b-73e0-44ef-87f5-b2bb4d7767f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:01.022508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5af8a93b-73e0-44ef-87f5-b2bb4d7767f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:01.049691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a30273b0-ecc3-4769-94c7-5da894f73861 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:01.057814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a30273b0-ecc3-4769-94c7-5da894f73861 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165540 Feb 21 01:08:01.058852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 820/1822] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:00 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:01.082773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5af8a93b-73e0-44ef-87f5-b2bb4d7767f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:01.090860 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5af8a93b-73e0-44ef-87f5-b2bb4d7767f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081090 Feb 21 01:08:01.091405 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1003/1823] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:01 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:01.414588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:01.415338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:01.423200 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:01.423760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:01.424807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:01.425338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:01.491116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:01.502333 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:01.503809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:01.504972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2e4314f6-ab16-40ee-86f0-05bc94914506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096454 Feb 21 01:08:01.505533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 821/1824] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:02.077259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-963fa8a5-e4c3-4af3-8f9d-47e057d35833 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:02.077998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-963fa8a5-e4c3-4af3-8f9d-47e057d35833 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:02.086287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-963fa8a5-e4c3-4af3-8f9d-47e057d35833 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:02.086848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-963fa8a5-e4c3-4af3-8f9d-47e057d35833 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:02.087800 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-963fa8a5-e4c3-4af3-8f9d-47e057d35833 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:02.088636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-963fa8a5-e4c3-4af3-8f9d-47e057d35833 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:02.108551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7afda33a-c281-40d3-a0f6-509ad84835b2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:02.109240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7afda33a-c281-40d3-a0f6-509ad84835b2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:02.116006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7afda33a-c281-40d3-a0f6-509ad84835b2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:02.116443 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7afda33a-c281-40d3-a0f6-509ad84835b2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:02.117264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7afda33a-c281-40d3-a0f6-509ad84835b2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:02.117689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7afda33a-c281-40d3-a0f6-509ad84835b2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:02.180053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7afda33a-c281-40d3-a0f6-509ad84835b2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:02.188262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7afda33a-c281-40d3-a0f6-509ad84835b2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.083377 Feb 21 01:08:02.189262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 822/1825] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:02 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:02.239281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-963fa8a5-e4c3-4af3-8f9d-47e057d35833 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:02.247440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-963fa8a5-e4c3-4af3-8f9d-47e057d35833 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.175232 Feb 21 01:08:02.248029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1004/1826] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:02 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:02.525530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:02.526141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:02.533229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:02.533681 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:02.534612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:02.535044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:02.596670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:02.605311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:02.606848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:02.608018 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d3c2b5c4-6fd7-4b16-bf2d-e3c62bff834a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087591 Feb 21 01:08:02.608612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 823/1827] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:03.208508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b986d71c-8755-4868-9c35-be1d501b582f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:03.209599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b986d71c-8755-4868-9c35-be1d501b582f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:03.217276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b986d71c-8755-4868-9c35-be1d501b582f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:03.217748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b986d71c-8755-4868-9c35-be1d501b582f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:03.218582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b986d71c-8755-4868-9c35-be1d501b582f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:03.219035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b986d71c-8755-4868-9c35-be1d501b582f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:03.264430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-31da71ea-cea7-43ee-9ddd-1a425bde307c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:03.265052 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-31da71ea-cea7-43ee-9ddd-1a425bde307c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:03.271767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31da71ea-cea7-43ee-9ddd-1a425bde307c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:03.272570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31da71ea-cea7-43ee-9ddd-1a425bde307c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:03.273353 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31da71ea-cea7-43ee-9ddd-1a425bde307c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:03.273936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31da71ea-cea7-43ee-9ddd-1a425bde307c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:03.283411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b986d71c-8755-4868-9c35-be1d501b582f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:03.291613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b986d71c-8755-4868-9c35-be1d501b582f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089426 Feb 21 01:08:03.292178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1005/1828] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:03 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:03.409108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31da71ea-cea7-43ee-9ddd-1a425bde307c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:03.417487 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-31da71ea-cea7-43ee-9ddd-1a425bde307c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156780 Feb 21 01:08:03.418072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 824/1829] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:03 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:03.629862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:03.630930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:03.638325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:03.638792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:03.639568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:03.639974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:03.706127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:03.719874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:03.722451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:03.724110 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7b809227-d0c1-46d8-b1ac-80ae1f3391e9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100277 Feb 21 01:08:03.725060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1006/1830] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:04.314267 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2936d210-4ccb-44c4-8bed-cd7272d46b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:04.315220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2936d210-4ccb-44c4-8bed-cd7272d46b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:04.324141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2936d210-4ccb-44c4-8bed-cd7272d46b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:04.324632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2936d210-4ccb-44c4-8bed-cd7272d46b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:04.325404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2936d210-4ccb-44c4-8bed-cd7272d46b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:04.325836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2936d210-4ccb-44c4-8bed-cd7272d46b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:04.400085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2936d210-4ccb-44c4-8bed-cd7272d46b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:04.408307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2936d210-4ccb-44c4-8bed-cd7272d46b43 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.100270 Feb 21 01:08:04.408909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 825/1831] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:04 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:04.437157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dadf7501-94dc-4c72-8bdf-fb6b21e755fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:04.437793 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dadf7501-94dc-4c72-8bdf-fb6b21e755fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:04.446841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dadf7501-94dc-4c72-8bdf-fb6b21e755fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:04.447290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dadf7501-94dc-4c72-8bdf-fb6b21e755fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:04.448063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dadf7501-94dc-4c72-8bdf-fb6b21e755fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:04.448554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dadf7501-94dc-4c72-8bdf-fb6b21e755fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:04.594380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dadf7501-94dc-4c72-8bdf-fb6b21e755fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:04.602361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dadf7501-94dc-4c72-8bdf-fb6b21e755fa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171073 Feb 21 01:08:04.602934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1007/1832] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:04 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:04.746915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:04.747903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:04.757946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:04.758675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:04.759932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:04.760697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:04.826465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:04.834679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:04.836602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:04.838413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0f35ff17-58a6-4494-8853-91ae4dcb2db6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097625 Feb 21 01:08:04.839154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 826/1833] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:05.429025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4b3c9652-e930-4dff-b650-686897536d16 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:05.430038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4b3c9652-e930-4dff-b650-686897536d16 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:05.436758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b3c9652-e930-4dff-b650-686897536d16 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:05.437221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b3c9652-e930-4dff-b650-686897536d16 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:05.438007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b3c9652-e930-4dff-b650-686897536d16 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:05.438475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b3c9652-e930-4dff-b650-686897536d16 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:05.498609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4b3c9652-e930-4dff-b650-686897536d16 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:05.506888 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4b3c9652-e930-4dff-b650-686897536d16 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084201 Feb 21 01:08:05.507451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1008/1834] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:05 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:05.623016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-431f9c03-c34c-43ed-8d6e-dc6ac0c9a891 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:05.624018 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-431f9c03-c34c-43ed-8d6e-dc6ac0c9a891 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:05.634609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-431f9c03-c34c-43ed-8d6e-dc6ac0c9a891 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:05.635341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-431f9c03-c34c-43ed-8d6e-dc6ac0c9a891 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:05.636660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-431f9c03-c34c-43ed-8d6e-dc6ac0c9a891 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:05.637369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-431f9c03-c34c-43ed-8d6e-dc6ac0c9a891 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:05.778364 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-431f9c03-c34c-43ed-8d6e-dc6ac0c9a891 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:05.790225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-431f9c03-c34c-43ed-8d6e-dc6ac0c9a891 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173121 Feb 21 01:08:05.790972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 827/1835] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:05 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:05.860339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:05.861395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:05.871677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:05.872703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:05.873751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:05.874451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:05.937632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:05.946461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:05.947941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:05.949100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e6e83879-6c70-4de4-b6c9-3fad673265a1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094914 Feb 21 01:08:05.949650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1009/1836] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:06.527095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9a6fa89b-2d31-404e-8b73-c2ab3362bee7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:06.527796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9a6fa89b-2d31-404e-8b73-c2ab3362bee7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:06.535056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a6fa89b-2d31-404e-8b73-c2ab3362bee7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:06.535545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a6fa89b-2d31-404e-8b73-c2ab3362bee7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:06.536374 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a6fa89b-2d31-404e-8b73-c2ab3362bee7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:06.536912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a6fa89b-2d31-404e-8b73-c2ab3362bee7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:06.599926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9a6fa89b-2d31-404e-8b73-c2ab3362bee7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:06.608548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9a6fa89b-2d31-404e-8b73-c2ab3362bee7 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086835 Feb 21 01:08:06.609107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 828/1837] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:06 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:06.815976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5d1e2f32-0d0c-43e1-bfc0-5d71d1f179ed tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:06.816922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5d1e2f32-0d0c-43e1-bfc0-5d71d1f179ed tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:06.825221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5d1e2f32-0d0c-43e1-bfc0-5d71d1f179ed tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:06.825661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5d1e2f32-0d0c-43e1-bfc0-5d71d1f179ed tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:06.826429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5d1e2f32-0d0c-43e1-bfc0-5d71d1f179ed tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:06.826847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5d1e2f32-0d0c-43e1-bfc0-5d71d1f179ed tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:06.972700 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:06.973427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:06.978979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5d1e2f32-0d0c-43e1-bfc0-5d71d1f179ed tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:06.979813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:06.980258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:06.981068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:06.981480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:06.987093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5d1e2f32-0d0c-43e1-bfc0-5d71d1f179ed tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.177343 Feb 21 01:08:06.987731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1010/1838] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:06 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:07.045622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:07.054326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:07.055855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:07.057016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-78689df4-f4f4-408c-b72c-dedb40cc8240 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088150 Feb 21 01:08:07.057575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 829/1839] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:06 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:08:07.628675 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bf766de1-2e61-46ee-a7f0-a2c4fd9006ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:07.629692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bf766de1-2e61-46ee-a7f0-a2c4fd9006ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:07.637521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf766de1-2e61-46ee-a7f0-a2c4fd9006ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:07.637966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf766de1-2e61-46ee-a7f0-a2c4fd9006ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:07.638747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf766de1-2e61-46ee-a7f0-a2c4fd9006ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:07.639180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bf766de1-2e61-46ee-a7f0-a2c4fd9006ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:07.702948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bf766de1-2e61-46ee-a7f0-a2c4fd9006ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:07.710827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bf766de1-2e61-46ee-a7f0-a2c4fd9006ef tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088418 Feb 21 01:08:07.711490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1011/1840] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:07 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:08.007598 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a20e7356-15cd-42d5-9461-77961f8306df tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:08.008202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a20e7356-15cd-42d5-9461-77961f8306df tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:08.018112 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a20e7356-15cd-42d5-9461-77961f8306df tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:08.018678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a20e7356-15cd-42d5-9461-77961f8306df tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:08.019835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a20e7356-15cd-42d5-9461-77961f8306df tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:08.020471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a20e7356-15cd-42d5-9461-77961f8306df tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:08.075006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:08.075696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:08.082526 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:08.083052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:08.083890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:08.084420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:08.147721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:08.156195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:08.157062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a20e7356-15cd-42d5-9461-77961f8306df tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:08.157704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:08.158831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e59e10cf-fd4a-4d3e-af3f-78ce83aa509f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087772 Feb 21 01:08:08.159541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1012/1841] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:08.165190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a20e7356-15cd-42d5-9461-77961f8306df tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163579 Feb 21 01:08:08.165716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 830/1842] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:07 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:08.731464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-daa9046a-c7bb-4a02-9ee9-6ef3c3ee6c0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:08.732298 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-daa9046a-c7bb-4a02-9ee9-6ef3c3ee6c0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:08.742514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-daa9046a-c7bb-4a02-9ee9-6ef3c3ee6c0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:08.743136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-daa9046a-c7bb-4a02-9ee9-6ef3c3ee6c0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:08.743954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-daa9046a-c7bb-4a02-9ee9-6ef3c3ee6c0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:08.744520 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-daa9046a-c7bb-4a02-9ee9-6ef3c3ee6c0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:08.805739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-daa9046a-c7bb-4a02-9ee9-6ef3c3ee6c0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:08.818460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-daa9046a-c7bb-4a02-9ee9-6ef3c3ee6c0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093079 Feb 21 01:08:08.819315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1013/1843] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:08 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:09.177473 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:09.178091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:09.181945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-05f0de0f-580b-4f06-9455-85a89e37b854 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:09.182561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-05f0de0f-580b-4f06-9455-85a89e37b854 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:09.184839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:09.185279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:09.186047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:09.186481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:09.189224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05f0de0f-580b-4f06-9455-85a89e37b854 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:09.189668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05f0de0f-580b-4f06-9455-85a89e37b854 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:09.190460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05f0de0f-580b-4f06-9455-85a89e37b854 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:09.190887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05f0de0f-580b-4f06-9455-85a89e37b854 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:09.246818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:09.255290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:09.256817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:09.257926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8dd34739-9937-4cea-b84e-92a62aa0e9b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.084440 Feb 21 01:08:09.258562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 831/1844] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:09.325941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-05f0de0f-580b-4f06-9455-85a89e37b854 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:09.334076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-05f0de0f-580b-4f06-9455-85a89e37b854 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.155912 Feb 21 01:08:09.334639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1014/1845] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:09 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:09.840160 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b5f184fa-7931-4ae3-bcb6-774a036d1059 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:09.841218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b5f184fa-7931-4ae3-bcb6-774a036d1059 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:09.851418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5f184fa-7931-4ae3-bcb6-774a036d1059 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:09.852225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5f184fa-7931-4ae3-bcb6-774a036d1059 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:09.853039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5f184fa-7931-4ae3-bcb6-774a036d1059 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:09.853462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5f184fa-7931-4ae3-bcb6-774a036d1059 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:09.914284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b5f184fa-7931-4ae3-bcb6-774a036d1059 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:09.922893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b5f184fa-7931-4ae3-bcb6-774a036d1059 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089013 Feb 21 01:08:09.923471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 832/1846] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:09 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:10.279992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:10.281027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:10.291643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:10.292428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:10.293743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:10.294432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:10.351194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0c19e96e-3ba7-4bb6-ba0a-079c7358bddb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:10.351824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0c19e96e-3ba7-4bb6-ba0a-079c7358bddb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:10.358403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c19e96e-3ba7-4bb6-ba0a-079c7358bddb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:10.358849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c19e96e-3ba7-4bb6-ba0a-079c7358bddb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:10.359622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c19e96e-3ba7-4bb6-ba0a-079c7358bddb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:10.360053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c19e96e-3ba7-4bb6-ba0a-079c7358bddb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:10.364167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:10.373319 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:10.374844 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:10.376005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7984a082-a3bd-46f8-b57e-4dc77e73caca tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102394 Feb 21 01:08:10.376556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1015/1847] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:10 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:10.502669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0c19e96e-3ba7-4bb6-ba0a-079c7358bddb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:10.510713 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0c19e96e-3ba7-4bb6-ba0a-079c7358bddb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163290 Feb 21 01:08:10.511289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 833/1848] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:10 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:08:10.945156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e546910c-e796-47d7-bb7e-f15e367e51d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:10.946300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e546910c-e796-47d7-bb7e-f15e367e51d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:10.956609 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e546910c-e796-47d7-bb7e-f15e367e51d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:10.957363 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e546910c-e796-47d7-bb7e-f15e367e51d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:10.958611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e546910c-e796-47d7-bb7e-f15e367e51d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:10.959316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e546910c-e796-47d7-bb7e-f15e367e51d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:11.027426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e546910c-e796-47d7-bb7e-f15e367e51d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:11.035451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e546910c-e796-47d7-bb7e-f15e367e51d1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096594 Feb 21 01:08:11.036008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1016/1849] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:10 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:11.399048 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:11.401032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:11.411771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:11.412560 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:11.413850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:11.414682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:11.480059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:11.488796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:11.490294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:11.491432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6c383807-11fa-47f6-9ab5-4db82528986a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.099076 Feb 21 01:08:11.491990 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 834/1850] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:11.527892 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cd86053c-e815-40a0-a9d5-20601973043e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:11.528547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cd86053c-e815-40a0-a9d5-20601973043e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:11.535428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cd86053c-e815-40a0-a9d5-20601973043e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:11.535877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cd86053c-e815-40a0-a9d5-20601973043e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:11.536710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cd86053c-e815-40a0-a9d5-20601973043e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:11.537143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cd86053c-e815-40a0-a9d5-20601973043e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:11.678222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cd86053c-e815-40a0-a9d5-20601973043e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:11.686138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cd86053c-e815-40a0-a9d5-20601973043e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162179 Feb 21 01:08:11.686709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1017/1851] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:11 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:12.056040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9d83e2c9-18cb-49af-9133-05bafde7be23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:12.057129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9d83e2c9-18cb-49af-9133-05bafde7be23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:12.067401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d83e2c9-18cb-49af-9133-05bafde7be23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:12.068134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d83e2c9-18cb-49af-9133-05bafde7be23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:12.069480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d83e2c9-18cb-49af-9133-05bafde7be23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:12.070214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9d83e2c9-18cb-49af-9133-05bafde7be23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:12.130235 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9d83e2c9-18cb-49af-9133-05bafde7be23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:12.139366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9d83e2c9-18cb-49af-9133-05bafde7be23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089483 Feb 21 01:08:12.139941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 835/1852] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:12 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:12.516049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:12.517134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:12.526580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:12.527025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:12.527837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:12.528754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:12.590415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:12.599157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:12.600666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:12.601814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-19ed8389-894f-4c37-a624-c75279c47dc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091996 Feb 21 01:08:12.602420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1018/1853] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:12.711605 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9db0cde0-378c-44ab-bceb-8f5054bc9309 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:12.712607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9db0cde0-378c-44ab-bceb-8f5054bc9309 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:12.722881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9db0cde0-378c-44ab-bceb-8f5054bc9309 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:12.723583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9db0cde0-378c-44ab-bceb-8f5054bc9309 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:12.724893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9db0cde0-378c-44ab-bceb-8f5054bc9309 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:12.725561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9db0cde0-378c-44ab-bceb-8f5054bc9309 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:12.863280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9db0cde0-378c-44ab-bceb-8f5054bc9309 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:12.875476 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9db0cde0-378c-44ab-bceb-8f5054bc9309 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169820 Feb 21 01:08:12.876306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 836/1854] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:12 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:13.163133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-360fcbc1-72f8-49ec-90e2-8bc2cfb66bd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:13.164011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-360fcbc1-72f8-49ec-90e2-8bc2cfb66bd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:13.174197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-360fcbc1-72f8-49ec-90e2-8bc2cfb66bd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:13.174941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-360fcbc1-72f8-49ec-90e2-8bc2cfb66bd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:13.176222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-360fcbc1-72f8-49ec-90e2-8bc2cfb66bd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:13.177011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-360fcbc1-72f8-49ec-90e2-8bc2cfb66bd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:13.239086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-360fcbc1-72f8-49ec-90e2-8bc2cfb66bd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:13.247568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-360fcbc1-72f8-49ec-90e2-8bc2cfb66bd9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090926 Feb 21 01:08:13.248126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1019/1855] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:13 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:13.625693 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:13.627511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:13.637815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:13.638267 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:13.639035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:13.639462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:13.706338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:13.715105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:13.716613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:13.717746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a3208b41-6f32-4b5d-848a-fd769f33ee50 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100232 Feb 21 01:08:13.718307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 837/1856] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:13.896743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4fd24947-748f-470f-9f32-68c4fb4ca95f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:13.897967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4fd24947-748f-470f-9f32-68c4fb4ca95f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:13.905460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4fd24947-748f-470f-9f32-68c4fb4ca95f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:13.905901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4fd24947-748f-470f-9f32-68c4fb4ca95f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:13.906684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4fd24947-748f-470f-9f32-68c4fb4ca95f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:13.907108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4fd24947-748f-470f-9f32-68c4fb4ca95f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:14.059669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4fd24947-748f-470f-9f32-68c4fb4ca95f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:14.067641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4fd24947-748f-470f-9f32-68c4fb4ca95f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.177028 Feb 21 01:08:14.068208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1020/1857] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:13 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:14.265469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4b6a6bc0-aa03-4cbb-8eb5-0d0a93231c87 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:14.266148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4b6a6bc0-aa03-4cbb-8eb5-0d0a93231c87 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:14.277045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b6a6bc0-aa03-4cbb-8eb5-0d0a93231c87 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:14.277782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b6a6bc0-aa03-4cbb-8eb5-0d0a93231c87 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:14.279041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b6a6bc0-aa03-4cbb-8eb5-0d0a93231c87 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:14.279760 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b6a6bc0-aa03-4cbb-8eb5-0d0a93231c87 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:14.346557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4b6a6bc0-aa03-4cbb-8eb5-0d0a93231c87 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:14.354719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4b6a6bc0-aa03-4cbb-8eb5-0d0a93231c87 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093316 Feb 21 01:08:14.355317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 838/1858] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:14 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:14.738212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:14.738994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:14.746662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:14.747081 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:14.747889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:14.748314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:14.807908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:14.816659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:14.818160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:14.819331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-373ccc6a-c885-4f31-b37f-340486b3ed56 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087170 Feb 21 01:08:14.819879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1021/1859] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:15.088596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b5f362b0-9db1-4f58-9f25-1d82156b1403 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:15.089458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b5f362b0-9db1-4f58-9f25-1d82156b1403 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:15.099573 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5f362b0-9db1-4f58-9f25-1d82156b1403 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:15.100304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5f362b0-9db1-4f58-9f25-1d82156b1403 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:15.101571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5f362b0-9db1-4f58-9f25-1d82156b1403 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:15.102429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5f362b0-9db1-4f58-9f25-1d82156b1403 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:15.243105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b5f362b0-9db1-4f58-9f25-1d82156b1403 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:15.251682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b5f362b0-9db1-4f58-9f25-1d82156b1403 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169369 Feb 21 01:08:15.252225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 839/1860] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:15 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:15.326463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:08:15.326687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:08:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:08:15.373218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b9fbfa4a-fe3a-4bb5-890c-322c1efa672a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:15.374119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b9fbfa4a-fe3a-4bb5-890c-322c1efa672a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:15.384799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9fbfa4a-fe3a-4bb5-890c-322c1efa672a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:15.385591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9fbfa4a-fe3a-4bb5-890c-322c1efa672a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:15.386833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9fbfa4a-fe3a-4bb5-890c-322c1efa672a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:15.387576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b9fbfa4a-fe3a-4bb5-890c-322c1efa672a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:15.452733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b9fbfa4a-fe3a-4bb5-890c-322c1efa672a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:15.462916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b9fbfa4a-fe3a-4bb5-890c-322c1efa672a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095592 Feb 21 01:08:15.463475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1022/1861] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:15 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:15.841273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:15.842257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:15.852992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:15.853802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:15.854576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:15.855000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:15.920496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:15.929199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:15.930692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:15.931910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-351e9d25-2bb1-40a3-a956-ce43d5383487 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096881 Feb 21 01:08:15.932487 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 840/1862] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:16.278083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4d9e2006-bfb8-4c11-972b-9611b7643d6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:16.279053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4d9e2006-bfb8-4c11-972b-9611b7643d6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:16.289096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d9e2006-bfb8-4c11-972b-9611b7643d6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:16.289808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d9e2006-bfb8-4c11-972b-9611b7643d6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:16.291271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d9e2006-bfb8-4c11-972b-9611b7643d6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:16.291713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d9e2006-bfb8-4c11-972b-9611b7643d6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:16.452154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4d9e2006-bfb8-4c11-972b-9611b7643d6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:16.464534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4d9e2006-bfb8-4c11-972b-9611b7643d6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.192778 Feb 21 01:08:16.465296 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1023/1863] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:16 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:16.593621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7074cd8a-d473-42d5-9a8f-ae4281adb940 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:16.594274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7074cd8a-d473-42d5-9a8f-ae4281adb940 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:16.600691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7074cd8a-d473-42d5-9a8f-ae4281adb940 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:16.601136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7074cd8a-d473-42d5-9a8f-ae4281adb940 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:16.601915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7074cd8a-d473-42d5-9a8f-ae4281adb940 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:16.602347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7074cd8a-d473-42d5-9a8f-ae4281adb940 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:16.662031 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7074cd8a-d473-42d5-9a8f-ae4281adb940 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:16.669983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7074cd8a-d473-42d5-9a8f-ae4281adb940 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.194449 Feb 21 01:08:16.670554 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 841/1864] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:16 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:16.954224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:16.955190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:16.964948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:16.965400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:16.966183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:16.966616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:17.027120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:17.036044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:17.037695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:17.038841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-079fed88-8094-4c5f-a10e-40732a196af3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091256 Feb 21 01:08:17.039439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1024/1865] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:16 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:17.482099 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5ccf5732-5bb3-4aa9-8acb-47159d597634 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:17.482714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5ccf5732-5bb3-4aa9-8acb-47159d597634 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:17.489152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ccf5732-5bb3-4aa9-8acb-47159d597634 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:17.489597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ccf5732-5bb3-4aa9-8acb-47159d597634 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:17.490367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ccf5732-5bb3-4aa9-8acb-47159d597634 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:17.490774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5ccf5732-5bb3-4aa9-8acb-47159d597634 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:17.629388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5ccf5732-5bb3-4aa9-8acb-47159d597634 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:17.640762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5ccf5732-5bb3-4aa9-8acb-47159d597634 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162231 Feb 21 01:08:17.641611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 842/1866] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:17 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:17.690448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-50f6169c-b2a4-44a8-b0f1-9acb900f7f6a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:17.691283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-50f6169c-b2a4-44a8-b0f1-9acb900f7f6a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:17.702499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-50f6169c-b2a4-44a8-b0f1-9acb900f7f6a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:17.703218 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-50f6169c-b2a4-44a8-b0f1-9acb900f7f6a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:17.704558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-50f6169c-b2a4-44a8-b0f1-9acb900f7f6a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:17.705287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-50f6169c-b2a4-44a8-b0f1-9acb900f7f6a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:17.768990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-50f6169c-b2a4-44a8-b0f1-9acb900f7f6a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:17.781265 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-50f6169c-b2a4-44a8-b0f1-9acb900f7f6a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096797 Feb 21 01:08:17.782042 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1025/1867] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:17 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:18.061050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:18.062054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:18.072383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:18.072882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:18.073660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:18.074088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:18.133815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:18.142337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:18.143819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:18.144954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a1ed3e3f-7207-4e17-a406-e5cfa737a47f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090256 Feb 21 01:08:18.145559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 843/1868] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:18.665170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d422a267-1cbe-4128-9019-634f738fd689 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:18.666288 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d422a267-1cbe-4128-9019-634f738fd689 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:18.672538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d422a267-1cbe-4128-9019-634f738fd689 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:18.672986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d422a267-1cbe-4128-9019-634f738fd689 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:18.673818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d422a267-1cbe-4128-9019-634f738fd689 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:18.674243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d422a267-1cbe-4128-9019-634f738fd689 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:18.801818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-251e6265-607f-4bc8-8c81-9d6bd926f8ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:18.802418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-251e6265-607f-4bc8-8c81-9d6bd926f8ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:18.808775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-251e6265-607f-4bc8-8c81-9d6bd926f8ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:18.809241 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-251e6265-607f-4bc8-8c81-9d6bd926f8ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:18.810019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-251e6265-607f-4bc8-8c81-9d6bd926f8ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:18.810439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-251e6265-607f-4bc8-8c81-9d6bd926f8ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:18.810880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d422a267-1cbe-4128-9019-634f738fd689 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:18.818899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d422a267-1cbe-4128-9019-634f738fd689 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159891 Feb 21 01:08:18.819465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1026/1869] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:18 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:18.869969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-251e6265-607f-4bc8-8c81-9d6bd926f8ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:18.878057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-251e6265-607f-4bc8-8c81-9d6bd926f8ba tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.080101 Feb 21 01:08:18.878627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 844/1870] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:18 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:08:19.167129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:19.168024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:19.178186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:19.178964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:19.180230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:19.180993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:19.247827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:19.260322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:19.261830 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:19.262978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-083e7c27-696a-47d6-8aad-ca2fc631b7ad tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102432 Feb 21 01:08:19.263537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1027/1871] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:19.719044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:08:19.719464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:08:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:08:19.840294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6bd1e547-534a-4857-97e4-7b9909a14fa0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:19.841351 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6bd1e547-534a-4857-97e4-7b9909a14fa0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:19.851952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6bd1e547-534a-4857-97e4-7b9909a14fa0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:19.852750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6bd1e547-534a-4857-97e4-7b9909a14fa0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:19.854016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6bd1e547-534a-4857-97e4-7b9909a14fa0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:19.854722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6bd1e547-534a-4857-97e4-7b9909a14fa0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:19.895036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-678a9fec-3855-4b71-9448-2b42357c1799 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:19.895745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-678a9fec-3855-4b71-9448-2b42357c1799 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:19.903234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-678a9fec-3855-4b71-9448-2b42357c1799 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:19.903679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-678a9fec-3855-4b71-9448-2b42357c1799 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:19.904556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-678a9fec-3855-4b71-9448-2b42357c1799 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:19.904985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-678a9fec-3855-4b71-9448-2b42357c1799 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:19.966017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-678a9fec-3855-4b71-9448-2b42357c1799 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:19.974016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-678a9fec-3855-4b71-9448-2b42357c1799 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082671 Feb 21 01:08:19.974582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1028/1872] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:19 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:19.997212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6bd1e547-534a-4857-97e4-7b9909a14fa0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:20.005297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6bd1e547-534a-4857-97e4-7b9909a14fa0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171603 Feb 21 01:08:20.005858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 845/1873] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:19 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:20.286029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:20.287031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:20.294997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:20.295441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:20.296211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:20.296671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:20.365166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:20.373569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:20.375682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:20.376144 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e3b2e5f3-4394-491e-a63d-943d3ab2b12c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096525 Feb 21 01:08:20.376780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1029/1874] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:20.994433 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bd87bb1a-9445-4987-83b3-f690110ae69b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:20.995431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bd87bb1a-9445-4987-83b3-f690110ae69b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:21.006140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd87bb1a-9445-4987-83b3-f690110ae69b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:21.006848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd87bb1a-9445-4987-83b3-f690110ae69b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:21.008171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd87bb1a-9445-4987-83b3-f690110ae69b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:21.008943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bd87bb1a-9445-4987-83b3-f690110ae69b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:21.022694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-03ca42c8-a35a-4b06-9072-98bff78dc255 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:21.023264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-03ca42c8-a35a-4b06-9072-98bff78dc255 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:21.030026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03ca42c8-a35a-4b06-9072-98bff78dc255 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:21.030473 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03ca42c8-a35a-4b06-9072-98bff78dc255 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:21.031224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03ca42c8-a35a-4b06-9072-98bff78dc255 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:21.031679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03ca42c8-a35a-4b06-9072-98bff78dc255 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:21.069601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bd87bb1a-9445-4987-83b3-f690110ae69b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:21.077961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bd87bb1a-9445-4987-83b3-f690110ae69b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089911 Feb 21 01:08:21.078535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 846/1875] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:20 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:21.173959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-03ca42c8-a35a-4b06-9072-98bff78dc255 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:21.182822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-03ca42c8-a35a-4b06-9072-98bff78dc255 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164155 Feb 21 01:08:21.183419 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1030/1876] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:21 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:21.398279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:21.399142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:21.406287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:21.406729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:21.407493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:21.407918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:21.467756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:21.476424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:21.477933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:21.479100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1460560e-0a0a-42ff-bf5b-0cbb49d6a506 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087590 Feb 21 01:08:21.479666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 847/1877] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:22.098086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fb517c30-a9c4-4ec0-a22d-0a96958d3dc5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:22.099075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fb517c30-a9c4-4ec0-a22d-0a96958d3dc5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:22.112672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb517c30-a9c4-4ec0-a22d-0a96958d3dc5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:22.113402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb517c30-a9c4-4ec0-a22d-0a96958d3dc5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:22.114692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb517c30-a9c4-4ec0-a22d-0a96958d3dc5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:22.115396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb517c30-a9c4-4ec0-a22d-0a96958d3dc5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:22.179424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb517c30-a9c4-4ec0-a22d-0a96958d3dc5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:22.187679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fb517c30-a9c4-4ec0-a22d-0a96958d3dc5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095711 Feb 21 01:08:22.188256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1031/1878] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:22 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:22.200302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c1fa1fba-b0ba-4581-9738-e01a4ffc07a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:22.200945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c1fa1fba-b0ba-4581-9738-e01a4ffc07a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:22.207390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fba-b0ba-4581-9738-e01a4ffc07a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:22.207840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fba-b0ba-4581-9738-e01a4ffc07a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:22.208649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fba-b0ba-4581-9738-e01a4ffc07a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:22.209074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1fa1fba-b0ba-4581-9738-e01a4ffc07a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:22.342509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c1fa1fba-b0ba-4581-9738-e01a4ffc07a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:22.354774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c1fa1fba-b0ba-4581-9738-e01a4ffc07a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159396 Feb 21 01:08:22.355322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 848/1879] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:22 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:22.500973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:22.502220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:22.511682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:22.512126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:22.512954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:22.513386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:22.574610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:22.583630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:22.585149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:22.586269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c14a82c2-71da-461c-9162-f2e877e252d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091570 Feb 21 01:08:22.586818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1032/1880] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:23.208315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-07973e7b-6bb5-4d4f-a958-c64ab865c129 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:23.209467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-07973e7b-6bb5-4d4f-a958-c64ab865c129 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:23.220277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07973e7b-6bb5-4d4f-a958-c64ab865c129 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:23.221082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07973e7b-6bb5-4d4f-a958-c64ab865c129 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:23.222355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07973e7b-6bb5-4d4f-a958-c64ab865c129 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:23.223071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07973e7b-6bb5-4d4f-a958-c64ab865c129 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:23.289269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-07973e7b-6bb5-4d4f-a958-c64ab865c129 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:23.297466 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-07973e7b-6bb5-4d4f-a958-c64ab865c129 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095308 Feb 21 01:08:23.298029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 849/1881] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:23 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:23.373476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f062bd4d-c4de-4b70-9511-30f150a7e269 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:23.374244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f062bd4d-c4de-4b70-9511-30f150a7e269 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:23.381974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f062bd4d-c4de-4b70-9511-30f150a7e269 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:23.382496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f062bd4d-c4de-4b70-9511-30f150a7e269 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:23.383398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f062bd4d-c4de-4b70-9511-30f150a7e269 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:23.383905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f062bd4d-c4de-4b70-9511-30f150a7e269 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:23.518530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f062bd4d-c4de-4b70-9511-30f150a7e269 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:23.526975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f062bd4d-c4de-4b70-9511-30f150a7e269 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158212 Feb 21 01:08:23.527782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1033/1882] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:23 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:23.603740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:23.604335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:23.610958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:23.611409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:23.612174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:23.612645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:23.672416 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:23.680876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:23.682493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:23.683624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-086bcdab-a7a4-4eb1-98a8-4f2eeca7383a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083665 Feb 21 01:08:23.684183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 850/1883] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:24.314285 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2b69eb86-1400-4a9a-a05e-9fcbe5658194 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:24.314896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2b69eb86-1400-4a9a-a05e-9fcbe5658194 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:24.321283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b69eb86-1400-4a9a-a05e-9fcbe5658194 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:24.321727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b69eb86-1400-4a9a-a05e-9fcbe5658194 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:24.322571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b69eb86-1400-4a9a-a05e-9fcbe5658194 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:24.323000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b69eb86-1400-4a9a-a05e-9fcbe5658194 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:24.406055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2b69eb86-1400-4a9a-a05e-9fcbe5658194 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:24.414188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2b69eb86-1400-4a9a-a05e-9fcbe5658194 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.103571 Feb 21 01:08:24.414781 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1034/1884] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:24 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:24.544184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3d2730b5-5933-4240-8a38-dae619c34621 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:24.544813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3d2730b5-5933-4240-8a38-dae619c34621 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:24.551709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d2730b5-5933-4240-8a38-dae619c34621 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:24.552148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d2730b5-5933-4240-8a38-dae619c34621 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:24.552967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d2730b5-5933-4240-8a38-dae619c34621 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:24.553419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3d2730b5-5933-4240-8a38-dae619c34621 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:24.687518 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3d2730b5-5933-4240-8a38-dae619c34621 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:24.699530 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3d2730b5-5933-4240-8a38-dae619c34621 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158703 Feb 21 01:08:24.700319 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 851/1885] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:24 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:24.707555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:24.708175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:24.714477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:24.716312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:24.716312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:24.716312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:24.783859 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:24.795554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:24.797413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:24.799193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-03391030-18dc-4251-950b-00f88b9a8637 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095402 Feb 21 01:08:24.800131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1035/1886] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:25.434961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f11cb413-62c5-43da-9386-490e2e44b6f2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:25.435569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f11cb413-62c5-43da-9386-490e2e44b6f2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:25.442035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f11cb413-62c5-43da-9386-490e2e44b6f2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:25.442484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f11cb413-62c5-43da-9386-490e2e44b6f2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:25.443263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f11cb413-62c5-43da-9386-490e2e44b6f2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:25.443696 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f11cb413-62c5-43da-9386-490e2e44b6f2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:25.504435 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f11cb413-62c5-43da-9386-490e2e44b6f2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:25.512841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f11cb413-62c5-43da-9386-490e2e44b6f2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081651 Feb 21 01:08:25.513419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 852/1887] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:25 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:25.717506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-96315a57-e22d-4281-8bb1-a4bda7506e7b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:25.718070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-96315a57-e22d-4281-8bb1-a4bda7506e7b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:25.724885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96315a57-e22d-4281-8bb1-a4bda7506e7b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:25.725328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96315a57-e22d-4281-8bb1-a4bda7506e7b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:25.726114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96315a57-e22d-4281-8bb1-a4bda7506e7b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:25.726536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96315a57-e22d-4281-8bb1-a4bda7506e7b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:25.821142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:25.821552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:25.830796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:25.831307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:25.832096 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:25.832602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:25.875743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-96315a57-e22d-4281-8bb1-a4bda7506e7b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:25.884030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-96315a57-e22d-4281-8bb1-a4bda7506e7b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.170453 Feb 21 01:08:25.884737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1036/1888] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:25 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:25.896036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:25.904824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:25.906313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:25.907442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2dd62353-d3ab-49fa-8f0a-d60fb5d94b71 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092143 Feb 21 01:08:25.907998 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 853/1889] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:26.530195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d949e097-3f81-4394-8b7c-fb421e6cd1c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:26.530859 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d949e097-3f81-4394-8b7c-fb421e6cd1c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:26.537722 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d949e097-3f81-4394-8b7c-fb421e6cd1c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.538174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d949e097-3f81-4394-8b7c-fb421e6cd1c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.538967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d949e097-3f81-4394-8b7c-fb421e6cd1c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.539397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d949e097-3f81-4394-8b7c-fb421e6cd1c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.601275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d949e097-3f81-4394-8b7c-fb421e6cd1c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:26.609336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d949e097-3f81-4394-8b7c-fb421e6cd1c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082875 Feb 21 01:08:26.609917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1037/1890] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:26 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:26.905923 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-93c3cddc-2a31-44bd-8b3a-fe85ef31de9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:26.906477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-93c3cddc-2a31-44bd-8b3a-fe85ef31de9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:26.916908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-93c3cddc-2a31-44bd-8b3a-fe85ef31de9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.917447 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-93c3cddc-2a31-44bd-8b3a-fe85ef31de9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.918314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-93c3cddc-2a31-44bd-8b3a-fe85ef31de9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.918841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-93c3cddc-2a31-44bd-8b3a-fe85ef31de9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.925317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:26.925922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:26.932662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.933088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:26.933891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:26.934323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:27.002927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:27.011356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:27.012867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:27.013993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-31dd48f0-9a8d-4b43-a183-d47200f3f667 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092514 Feb 21 01:08:27.014555 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1038/1891] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:26 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:27.059548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-93c3cddc-2a31-44bd-8b3a-fe85ef31de9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:27.067893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-93c3cddc-2a31-44bd-8b3a-fe85ef31de9a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168776 Feb 21 01:08:27.068493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 854/1892] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:26 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:27.626494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c43198a2-bf6f-4298-92a9-2fd4d067477d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:27.627109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c43198a2-bf6f-4298-92a9-2fd4d067477d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:27.633643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c43198a2-bf6f-4298-92a9-2fd4d067477d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:27.634087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c43198a2-bf6f-4298-92a9-2fd4d067477d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:27.634949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c43198a2-bf6f-4298-92a9-2fd4d067477d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:27.635389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c43198a2-bf6f-4298-92a9-2fd4d067477d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:27.699389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c43198a2-bf6f-4298-92a9-2fd4d067477d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:27.707273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c43198a2-bf6f-4298-92a9-2fd4d067477d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084589 Feb 21 01:08:27.707844 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1039/1893] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:27 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:28.033054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:28.033685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:28.040575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:28.041023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:28.041814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:28.042246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:28.086063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2ad77e16-6826-4602-b414-52118c0267ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:28.086706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2ad77e16-6826-4602-b414-52118c0267ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:28.093364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ad77e16-6826-4602-b414-52118c0267ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:28.093805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ad77e16-6826-4602-b414-52118c0267ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:28.094595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ad77e16-6826-4602-b414-52118c0267ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:28.095025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ad77e16-6826-4602-b414-52118c0267ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:28.103092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:28.111864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:28.113389 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:28.114539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c7db2c2b-6194-424b-8eaa-969e61497711 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085800 Feb 21 01:08:28.115311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 855/1894] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:28.226631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2ad77e16-6826-4602-b414-52118c0267ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:28.234799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2ad77e16-6826-4602-b414-52118c0267ec tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.152439 Feb 21 01:08:28.235371 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1040/1895] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:28 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:08:28.724594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cdffd94b-a294-40a3-a12a-440e1f544c83 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:28.725127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cdffd94b-a294-40a3-a12a-440e1f544c83 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:28.731757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdffd94b-a294-40a3-a12a-440e1f544c83 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:28.732206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdffd94b-a294-40a3-a12a-440e1f544c83 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:28.733026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdffd94b-a294-40a3-a12a-440e1f544c83 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:28.733444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdffd94b-a294-40a3-a12a-440e1f544c83 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:28.794548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cdffd94b-a294-40a3-a12a-440e1f544c83 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:28.803105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cdffd94b-a294-40a3-a12a-440e1f544c83 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082377 Feb 21 01:08:28.803679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 856/1896] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:28 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:29.133357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:29.133968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:29.140940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:29.141390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:29.142307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:29.142736 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:29.203730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:29.212225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:29.213788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:29.214978 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a01bf37b-e3d6-48a1-a5ee-e788031c9527 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085416 Feb 21 01:08:29.215567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1041/1897] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:29.251931 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-823137d0-3f31-47ba-8bac-728926da3649 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:29.252555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-823137d0-3f31-47ba-8bac-728926da3649 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:29.258728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-823137d0-3f31-47ba-8bac-728926da3649 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:29.259176 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-823137d0-3f31-47ba-8bac-728926da3649 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:29.260058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-823137d0-3f31-47ba-8bac-728926da3649 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:29.260521 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-823137d0-3f31-47ba-8bac-728926da3649 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:29.412318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-823137d0-3f31-47ba-8bac-728926da3649 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:29.424035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-823137d0-3f31-47ba-8bac-728926da3649 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.175642 Feb 21 01:08:29.424780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 857/1898] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:29 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:29.823777 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e293b04f-41d6-4346-a5ec-30082265a13f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:29.824430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e293b04f-41d6-4346-a5ec-30082265a13f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:29.831207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e293b04f-41d6-4346-a5ec-30082265a13f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:29.831650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e293b04f-41d6-4346-a5ec-30082265a13f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:29.832417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e293b04f-41d6-4346-a5ec-30082265a13f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:29.832877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e293b04f-41d6-4346-a5ec-30082265a13f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:29.896501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e293b04f-41d6-4346-a5ec-30082265a13f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:29.905045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e293b04f-41d6-4346-a5ec-30082265a13f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086803 Feb 21 01:08:29.905614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1042/1899] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:29 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:30.235179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:30.235785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:30.243478 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:30.243970 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:30.244919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:30.245344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:30.317986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:30.328330 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:30.329981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:30.331144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1d7cdc84-f253-4382-a7f6-13929bbd790e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101168 Feb 21 01:08:30.331704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 858/1900] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:30.445193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2fd08057-3548-476a-8eb8-0339074736e0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:30.446305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2fd08057-3548-476a-8eb8-0339074736e0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:30.456915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2fd08057-3548-476a-8eb8-0339074736e0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:30.457653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2fd08057-3548-476a-8eb8-0339074736e0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:30.458917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2fd08057-3548-476a-8eb8-0339074736e0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:30.459621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2fd08057-3548-476a-8eb8-0339074736e0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:30.598322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2fd08057-3548-476a-8eb8-0339074736e0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:30.606677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2fd08057-3548-476a-8eb8-0339074736e0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.167813 Feb 21 01:08:30.607241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1043/1901] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:30 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:30.925761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7a8065e2-1a8d-4f21-a2a6-f78261fe9d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:30.926639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7a8065e2-1a8d-4f21-a2a6-f78261fe9d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:30.935030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7a8065e2-1a8d-4f21-a2a6-f78261fe9d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:30.935470 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7a8065e2-1a8d-4f21-a2a6-f78261fe9d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:30.936283 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7a8065e2-1a8d-4f21-a2a6-f78261fe9d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:30.936750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7a8065e2-1a8d-4f21-a2a6-f78261fe9d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:31.008420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7a8065e2-1a8d-4f21-a2a6-f78261fe9d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:31.017368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7a8065e2-1a8d-4f21-a2a6-f78261fe9d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.098028 Feb 21 01:08:31.017942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 859/1902] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:30 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:31.349790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:31.350410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:31.356937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:31.357382 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:31.358172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:31.358592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:31.420330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:31.429260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:31.430757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:31.432135 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-169bc4c2-095e-4cb2-a1ae-638b75f2e509 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086287 Feb 21 01:08:31.432956 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1044/1903] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:31 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:31.557133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:08:31.557752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:08:31.627327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-265da8fe-efcc-4d47-ba6a-71a758ffc196 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:31.628329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-265da8fe-efcc-4d47-ba6a-71a758ffc196 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:31.639125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-265da8fe-efcc-4d47-ba6a-71a758ffc196 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:31.639872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-265da8fe-efcc-4d47-ba6a-71a758ffc196 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:31.641221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-265da8fe-efcc-4d47-ba6a-71a758ffc196 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:31.641952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-265da8fe-efcc-4d47-ba6a-71a758ffc196 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:31.795805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-265da8fe-efcc-4d47-ba6a-71a758ffc196 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:31.807781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-265da8fe-efcc-4d47-ba6a-71a758ffc196 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.186494 Feb 21 01:08:31.808282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 860/1904] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:31 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:32.035696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fbc8d7aa-3e6d-4816-8048-5c64320dd769 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:32.036575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fbc8d7aa-3e6d-4816-8048-5c64320dd769 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:32.045082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fbc8d7aa-3e6d-4816-8048-5c64320dd769 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:32.045528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fbc8d7aa-3e6d-4816-8048-5c64320dd769 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:32.046309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fbc8d7aa-3e6d-4816-8048-5c64320dd769 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:32.046739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fbc8d7aa-3e6d-4816-8048-5c64320dd769 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:32.108538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fbc8d7aa-3e6d-4816-8048-5c64320dd769 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:32.117061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fbc8d7aa-3e6d-4816-8048-5c64320dd769 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086085 Feb 21 01:08:32.117623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1045/1905] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:32 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:32.454188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:32.455107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:32.465092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:32.465815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:32.466783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:32.467217 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:32.528973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:32.537400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:32.538871 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:32.539999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8eee9ce9-5bff-4eed-864d-861e0e45f075 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092342 Feb 21 01:08:32.540579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 861/1906] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:32 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:32.619881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:08:32.620784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:08:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:08:32.828430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5ba5b580-aafa-4a90-9293-eca930e9db1a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:32.829465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5ba5b580-aafa-4a90-9293-eca930e9db1a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:32.839699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ba5b580-aafa-4a90-9293-eca930e9db1a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:32.840445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ba5b580-aafa-4a90-9293-eca930e9db1a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:32.841768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ba5b580-aafa-4a90-9293-eca930e9db1a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:32.842466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5ba5b580-aafa-4a90-9293-eca930e9db1a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:32.991094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5ba5b580-aafa-4a90-9293-eca930e9db1a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:32.999147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5ba5b580-aafa-4a90-9293-eca930e9db1a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176920 Feb 21 01:08:32.999722 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1046/1907] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:32 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:33.138415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-756638c9-3680-40b5-894b-02c2f656b913 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:33.139305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-756638c9-3680-40b5-894b-02c2f656b913 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:33.150266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-756638c9-3680-40b5-894b-02c2f656b913 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:33.150909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-756638c9-3680-40b5-894b-02c2f656b913 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:33.151674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-756638c9-3680-40b5-894b-02c2f656b913 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:33.152101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-756638c9-3680-40b5-894b-02c2f656b913 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:33.213509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-756638c9-3680-40b5-894b-02c2f656b913 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:33.221415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-756638c9-3680-40b5-894b-02c2f656b913 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089562 Feb 21 01:08:33.221970 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 862/1908] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:33 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:33.562749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:33.563344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:33.569832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:33.570284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:33.571052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:33.571491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:33.635213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:33.644125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:33.645671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:33.647192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a5bb851d-5f2c-4390-bce3-8b9470dec735 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087893 Feb 21 01:08:33.647762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1047/1909] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:33 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:08:34.019578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e8a52bf9-421e-4378-8a32-817e2b209c5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:34.020612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e8a52bf9-421e-4378-8a32-817e2b209c5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:34.029055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8a52bf9-421e-4378-8a32-817e2b209c5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:34.029488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8a52bf9-421e-4378-8a32-817e2b209c5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:34.030259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8a52bf9-421e-4378-8a32-817e2b209c5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:34.030684 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8a52bf9-421e-4378-8a32-817e2b209c5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:34.180110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8a52bf9-421e-4378-8a32-817e2b209c5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:34.188616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e8a52bf9-421e-4378-8a32-817e2b209c5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.175200 Feb 21 01:08:34.189190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 863/1910] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:34 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:34.238546 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-809b4e35-1ecf-458d-889d-9fc2c4ed163c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:34.239151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-809b4e35-1ecf-458d-889d-9fc2c4ed163c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:34.245557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-809b4e35-1ecf-458d-889d-9fc2c4ed163c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:34.245995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-809b4e35-1ecf-458d-889d-9fc2c4ed163c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:34.246766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-809b4e35-1ecf-458d-889d-9fc2c4ed163c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:34.247183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-809b4e35-1ecf-458d-889d-9fc2c4ed163c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:34.307507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-809b4e35-1ecf-458d-889d-9fc2c4ed163c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:34.315897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-809b4e35-1ecf-458d-889d-9fc2c4ed163c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081104 Feb 21 01:08:34.316472 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1048/1911] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:34 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:34.669739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:34.670645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:34.680853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:34.681675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:34.682448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:34.682876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:34.754007 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:34.766494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:34.768913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:34.770683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8dd700d0-d495-4942-bc67-934c0b4db916 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.107092 Feb 21 01:08:34.771775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 864/1912] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:34 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:35.209490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ad6fdd46-4359-4a3d-b6dc-8f4e348dac52 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:35.210422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ad6fdd46-4359-4a3d-b6dc-8f4e348dac52 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:35.221180 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad6fdd46-4359-4a3d-b6dc-8f4e348dac52 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:35.221906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad6fdd46-4359-4a3d-b6dc-8f4e348dac52 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:35.223166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad6fdd46-4359-4a3d-b6dc-8f4e348dac52 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:35.223883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad6fdd46-4359-4a3d-b6dc-8f4e348dac52 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:35.332427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ebb2fab5-9c79-4025-9827-360729ad31dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:35.333091 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ebb2fab5-9c79-4025-9827-360729ad31dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:35.339221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ebb2fab5-9c79-4025-9827-360729ad31dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:35.339660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ebb2fab5-9c79-4025-9827-360729ad31dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:35.340440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ebb2fab5-9c79-4025-9827-360729ad31dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:35.340850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ebb2fab5-9c79-4025-9827-360729ad31dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:35.367011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ad6fdd46-4359-4a3d-b6dc-8f4e348dac52 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:35.375181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ad6fdd46-4359-4a3d-b6dc-8f4e348dac52 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171926 Feb 21 01:08:35.375748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1049/1913] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:35 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:35.400123 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ebb2fab5-9c79-4025-9827-360729ad31dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:35.408520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ebb2fab5-9c79-4025-9827-360729ad31dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.079847 Feb 21 01:08:35.409092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 865/1914] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:35 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:35.793724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:35.794610 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:35.804761 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:35.805498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:35.806770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:35.807521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:35.880571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:35.891127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:35.892651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:35.893775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-236d4d49-d81a-40e5-8ba5-84596cf10d4b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.106521 Feb 21 01:08:35.894367 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1050/1915] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:35 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:36.396207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9a20c5c3-6900-4497-96ee-d9c12a6a690e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:36.397596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9a20c5c3-6900-4497-96ee-d9c12a6a690e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:36.405778 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a20c5c3-6900-4497-96ee-d9c12a6a690e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:36.406248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a20c5c3-6900-4497-96ee-d9c12a6a690e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:36.407022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a20c5c3-6900-4497-96ee-d9c12a6a690e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:36.407448 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9a20c5c3-6900-4497-96ee-d9c12a6a690e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:36.425463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-180f22b2-a9f7-43be-baf2-5d131ccaeba2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:36.426027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-180f22b2-a9f7-43be-baf2-5d131ccaeba2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:36.432703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-180f22b2-a9f7-43be-baf2-5d131ccaeba2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:36.433145 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-180f22b2-a9f7-43be-baf2-5d131ccaeba2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:36.433922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-180f22b2-a9f7-43be-baf2-5d131ccaeba2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:36.434349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-180f22b2-a9f7-43be-baf2-5d131ccaeba2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:36.494715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-180f22b2-a9f7-43be-baf2-5d131ccaeba2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:36.503084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-180f22b2-a9f7-43be-baf2-5d131ccaeba2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081212 Feb 21 01:08:36.503694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1051/1916] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:36 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:36.545666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9a20c5c3-6900-4497-96ee-d9c12a6a690e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:36.553633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9a20c5c3-6900-4497-96ee-d9c12a6a690e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163558 Feb 21 01:08:36.554183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 866/1917] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:36 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:36.912618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:36.913221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:36.923210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:36.924613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:36.925406 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:36.925833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:36.995296 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:37.004314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:37.005870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:37.007006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a0c41c4f-ea68-42fd-a314-0959da477b52 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098542 Feb 21 01:08:37.007578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1052/1918] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:36 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:37.186020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:08:37.186309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:08:37.520641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a97ff2f6-c87a-415d-bcc7-3c2a71ad6a27 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:37.521303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a97ff2f6-c87a-415d-bcc7-3c2a71ad6a27 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:37.528430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a97ff2f6-c87a-415d-bcc7-3c2a71ad6a27 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:37.528897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a97ff2f6-c87a-415d-bcc7-3c2a71ad6a27 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:37.529691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a97ff2f6-c87a-415d-bcc7-3c2a71ad6a27 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:37.530151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a97ff2f6-c87a-415d-bcc7-3c2a71ad6a27 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:37.576088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8794ff2e-d738-4a28-85aa-54ea23bce3b4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:37.576710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8794ff2e-d738-4a28-85aa-54ea23bce3b4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:37.583505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8794ff2e-d738-4a28-85aa-54ea23bce3b4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:37.583945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8794ff2e-d738-4a28-85aa-54ea23bce3b4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:37.584752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8794ff2e-d738-4a28-85aa-54ea23bce3b4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:37.585181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8794ff2e-d738-4a28-85aa-54ea23bce3b4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:37.591507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a97ff2f6-c87a-415d-bcc7-3c2a71ad6a27 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:37.599576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a97ff2f6-c87a-415d-bcc7-3c2a71ad6a27 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.083387 Feb 21 01:08:37.600105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 867/1919] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:37 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:37.720100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8794ff2e-d738-4a28-85aa-54ea23bce3b4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:37.728109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8794ff2e-d738-4a28-85aa-54ea23bce3b4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.155886 Feb 21 01:08:37.728695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1053/1920] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:37 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:38.028859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:38.029900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:38.040287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:38.041087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:38.042308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:38.042738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:38.105183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:38.113556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:38.115030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:38.116190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b989d1fa-40ea-4461-97e0-64acf7694fc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093531 Feb 21 01:08:38.116807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 868/1921] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:38 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:38.620353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-672258a6-043d-42cb-ba55-8a3f487ab144 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:38.621247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-672258a6-043d-42cb-ba55-8a3f487ab144 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:38.631786 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-672258a6-043d-42cb-ba55-8a3f487ab144 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:38.632563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-672258a6-043d-42cb-ba55-8a3f487ab144 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:38.633838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-672258a6-043d-42cb-ba55-8a3f487ab144 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:38.634585 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-672258a6-043d-42cb-ba55-8a3f487ab144 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:38.701364 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-672258a6-043d-42cb-ba55-8a3f487ab144 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:38.709535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-672258a6-043d-42cb-ba55-8a3f487ab144 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095488 Feb 21 01:08:38.710114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1054/1922] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:38 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:38.745220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2dff9920-6810-417f-bc27-5d00dca7afcd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:38.745816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2dff9920-6810-417f-bc27-5d00dca7afcd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:38.752222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2dff9920-6810-417f-bc27-5d00dca7afcd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:38.752741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2dff9920-6810-417f-bc27-5d00dca7afcd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:38.753509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2dff9920-6810-417f-bc27-5d00dca7afcd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:38.753935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2dff9920-6810-417f-bc27-5d00dca7afcd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:38.893149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2dff9920-6810-417f-bc27-5d00dca7afcd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:38.905903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2dff9920-6810-417f-bc27-5d00dca7afcd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164150 Feb 21 01:08:38.906677 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 869/1923] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:38 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:39.138173 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:39.139159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:39.149696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:39.150327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:39.151711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:39.152160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:39.210965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:39.219607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:39.221185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:39.222318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-31e9ddcf-a129-45be-8946-4c8f8db48917 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.090415 Feb 21 01:08:39.222905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1055/1924] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:39 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:39.730341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2adacfb0-dac5-4936-bc86-16f1133e0f08 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:39.731042 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2adacfb0-dac5-4936-bc86-16f1133e0f08 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:39.737882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2adacfb0-dac5-4936-bc86-16f1133e0f08 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:39.738386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2adacfb0-dac5-4936-bc86-16f1133e0f08 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:39.739237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2adacfb0-dac5-4936-bc86-16f1133e0f08 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:39.739716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2adacfb0-dac5-4936-bc86-16f1133e0f08 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:39.800414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2adacfb0-dac5-4936-bc86-16f1133e0f08 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:39.808711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2adacfb0-dac5-4936-bc86-16f1133e0f08 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084446 Feb 21 01:08:39.809287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 870/1925] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:39 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:39.928450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f32f1c19-917f-4d7c-a8c3-46b85fd3ec89 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:39.929166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f32f1c19-917f-4d7c-a8c3-46b85fd3ec89 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:39.936537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f32f1c19-917f-4d7c-a8c3-46b85fd3ec89 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:39.936985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f32f1c19-917f-4d7c-a8c3-46b85fd3ec89 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:39.937763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f32f1c19-917f-4d7c-a8c3-46b85fd3ec89 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:39.938196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f32f1c19-917f-4d7c-a8c3-46b85fd3ec89 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:40.080767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f32f1c19-917f-4d7c-a8c3-46b85fd3ec89 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:40.088867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f32f1c19-917f-4d7c-a8c3-46b85fd3ec89 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164737 Feb 21 01:08:40.089528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1056/1926] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:39 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:40.243925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:40.244985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:40.255016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:40.255758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:40.257088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:40.257808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:40.319231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:40.328005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:40.329606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:40.330712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-09961332-ceeb-4cf6-b331-95dcedfb41c2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092924 Feb 21 01:08:40.331284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 871/1927] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:40 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:40.829658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7eb2c2bd-3bd8-4661-abd4-c0e3b853c081 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:40.830669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7eb2c2bd-3bd8-4661-abd4-c0e3b853c081 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:40.840434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb2c2bd-3bd8-4661-abd4-c0e3b853c081 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:40.840878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb2c2bd-3bd8-4661-abd4-c0e3b853c081 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:40.841776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb2c2bd-3bd8-4661-abd4-c0e3b853c081 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:40.842209 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7eb2c2bd-3bd8-4661-abd4-c0e3b853c081 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:40.902961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7eb2c2bd-3bd8-4661-abd4-c0e3b853c081 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:40.911227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7eb2c2bd-3bd8-4661-abd4-c0e3b853c081 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.087939 Feb 21 01:08:40.911790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1057/1928] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:40 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:41.110471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f339faee-a47d-44b4-8d49-4f0d7099f895 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:41.111365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f339faee-a47d-44b4-8d49-4f0d7099f895 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:41.122022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f339faee-a47d-44b4-8d49-4f0d7099f895 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:41.122757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f339faee-a47d-44b4-8d49-4f0d7099f895 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:41.124035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f339faee-a47d-44b4-8d49-4f0d7099f895 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:41.124809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f339faee-a47d-44b4-8d49-4f0d7099f895 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:41.266297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f339faee-a47d-44b4-8d49-4f0d7099f895 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:41.279238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f339faee-a47d-44b4-8d49-4f0d7099f895 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.175074 Feb 21 01:08:41.279953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 872/1929] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:41 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:41.358373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:41.359394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:41.370226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:41.370716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:41.371483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:41.371906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:41.444252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:41.456651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:41.458936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:41.460594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7c63e58b-051c-403d-a29c-a9e311991f6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.108232 Feb 21 01:08:41.461334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1058/1930] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:41 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:41.931667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-062121a4-ea05-48b1-b6b3-1adc3601e8fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:41.932576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-062121a4-ea05-48b1-b6b3-1adc3601e8fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:41.942726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-062121a4-ea05-48b1-b6b3-1adc3601e8fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:41.943411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-062121a4-ea05-48b1-b6b3-1adc3601e8fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:41.944639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-062121a4-ea05-48b1-b6b3-1adc3601e8fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:41.945281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-062121a4-ea05-48b1-b6b3-1adc3601e8fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:42.012742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-062121a4-ea05-48b1-b6b3-1adc3601e8fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:42.021662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-062121a4-ea05-48b1-b6b3-1adc3601e8fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095785 Feb 21 01:08:42.022254 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 873/1931] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:41 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:42.305465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-15b84f18-c973-4609-a940-90d15b5a5e7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:42.306365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-15b84f18-c973-4609-a940-90d15b5a5e7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:42.313674 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15b84f18-c973-4609-a940-90d15b5a5e7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:42.314119 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15b84f18-c973-4609-a940-90d15b5a5e7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:42.314903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15b84f18-c973-4609-a940-90d15b5a5e7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:42.315327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15b84f18-c973-4609-a940-90d15b5a5e7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:42.469499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-15b84f18-c973-4609-a940-90d15b5a5e7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:42.479091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-15b84f18-c973-4609-a940-90d15b5a5e7e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.180001 Feb 21 01:08:42.479290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:42.479817 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1059/1932] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:42 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:42.480061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:42.486763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:42.487205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:42.487972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:42.488428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:42.553245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:42.561912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:42.563321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:42.564481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e20c90d8-990b-4141-9b9e-d5ad6cf4eac5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089090 Feb 21 01:08:42.565037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 874/1933] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:42 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:43.045679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0d6cbc18-1676-4ca9-b3b5-21175212c499 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:43.047264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0d6cbc18-1676-4ca9-b3b5-21175212c499 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:43.054613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d6cbc18-1676-4ca9-b3b5-21175212c499 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:43.055071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d6cbc18-1676-4ca9-b3b5-21175212c499 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:43.055878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d6cbc18-1676-4ca9-b3b5-21175212c499 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:43.056311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d6cbc18-1676-4ca9-b3b5-21175212c499 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:43.117361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0d6cbc18-1676-4ca9-b3b5-21175212c499 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:43.125792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0d6cbc18-1676-4ca9-b3b5-21175212c499 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085206 Feb 21 01:08:43.126394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1060/1934] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:43 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:43.500765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b5ee38d7-9689-438e-8acf-b506ba20b4eb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:43.501757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b5ee38d7-9689-438e-8acf-b506ba20b4eb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:43.512157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5ee38d7-9689-438e-8acf-b506ba20b4eb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:43.512637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5ee38d7-9689-438e-8acf-b506ba20b4eb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:43.513413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5ee38d7-9689-438e-8acf-b506ba20b4eb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:43.513853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b5ee38d7-9689-438e-8acf-b506ba20b4eb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:43.582876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:43.583913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:43.590126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:43.590541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:43.591328 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:43.591758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:43.650389 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b5ee38d7-9689-438e-8acf-b506ba20b4eb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:43.651627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:43.658314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b5ee38d7-9689-438e-8acf-b506ba20b4eb tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163995 Feb 21 01:08:43.658906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 875/1935] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:43 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:43.660122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:43.661692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:43.662818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-becb2c62-5bd0-4b63-9c7f-9279bf7fd059 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.084055 Feb 21 01:08:43.663354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1061/1936] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:43 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:08:44.147182 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ed1e2ba8-6845-4460-8f29-5a58e8bb3320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:44.148184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ed1e2ba8-6845-4460-8f29-5a58e8bb3320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:44.158420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ed1e2ba8-6845-4460-8f29-5a58e8bb3320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:44.159156 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ed1e2ba8-6845-4460-8f29-5a58e8bb3320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:44.160457 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ed1e2ba8-6845-4460-8f29-5a58e8bb3320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:44.161222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ed1e2ba8-6845-4460-8f29-5a58e8bb3320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:44.223762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ed1e2ba8-6845-4460-8f29-5a58e8bb3320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:44.232428 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ed1e2ba8-6845-4460-8f29-5a58e8bb3320 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091889 Feb 21 01:08:44.233008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 876/1937] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:44 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:44.679232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f05ff3b1-6925-4498-a8ae-ad74ebb92652 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:44.680334 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f05ff3b1-6925-4498-a8ae-ad74ebb92652 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:44.683943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:44.685017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:44.690954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f05ff3b1-6925-4498-a8ae-ad74ebb92652 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:44.691694 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f05ff3b1-6925-4498-a8ae-ad74ebb92652 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:44.693214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f05ff3b1-6925-4498-a8ae-ad74ebb92652 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:44.693939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f05ff3b1-6925-4498-a8ae-ad74ebb92652 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:44.695415 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:44.696158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:44.697747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:44.698227 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:44.763120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:44.772003 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:44.773520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:44.774644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f593721e-e2c2-4a31-bac9-d1f9715c6b15 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.096796 Feb 21 01:08:44.775195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 877/1938] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:44 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:44.834812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f05ff3b1-6925-4498-a8ae-ad74ebb92652 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:44.847110 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f05ff3b1-6925-4498-a8ae-ad74ebb92652 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173955 Feb 21 01:08:44.847914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1062/1939] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:44 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:45.251562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-75045e18-0e50-4602-b8b8-786cf8e2a0b0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:45.252627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-75045e18-0e50-4602-b8b8-786cf8e2a0b0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:45.262608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75045e18-0e50-4602-b8b8-786cf8e2a0b0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:45.263399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75045e18-0e50-4602-b8b8-786cf8e2a0b0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:45.264720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75045e18-0e50-4602-b8b8-786cf8e2a0b0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:45.265424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-75045e18-0e50-4602-b8b8-786cf8e2a0b0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:45.333466 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-75045e18-0e50-4602-b8b8-786cf8e2a0b0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:45.341656 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-75045e18-0e50-4602-b8b8-786cf8e2a0b0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095762 Feb 21 01:08:45.342195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 878/1940] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:45 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:45.796573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:45.797575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:45.808350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:45.809147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:45.810330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:45.810760 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:45.867020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d25f4a46-d946-4864-9a59-1e84e4b77572 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:45.867726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d25f4a46-d946-4864-9a59-1e84e4b77572 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:45.871072 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:45.874893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d25f4a46-d946-4864-9a59-1e84e4b77572 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:45.875450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d25f4a46-d946-4864-9a59-1e84e4b77572 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:45.876307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d25f4a46-d946-4864-9a59-1e84e4b77572 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:45.876933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d25f4a46-d946-4864-9a59-1e84e4b77572 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:45.879611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:45.881125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:45.882248 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cf7a8484-f015-4c19-abe7-307e10ea0282 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092070 Feb 21 01:08:45.882813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1063/1941] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:45 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:46.013566 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d25f4a46-d946-4864-9a59-1e84e4b77572 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:46.022442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d25f4a46-d946-4864-9a59-1e84e4b77572 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159149 Feb 21 01:08:46.023005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 879/1942] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:45 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:46.362337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c89fb335-ff5e-4b6f-b616-d92c87deecf0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:46.363404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c89fb335-ff5e-4b6f-b616-d92c87deecf0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:46.373710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c89fb335-ff5e-4b6f-b616-d92c87deecf0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:46.374481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c89fb335-ff5e-4b6f-b616-d92c87deecf0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:46.375722 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c89fb335-ff5e-4b6f-b616-d92c87deecf0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:46.376470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c89fb335-ff5e-4b6f-b616-d92c87deecf0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:46.440239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c89fb335-ff5e-4b6f-b616-d92c87deecf0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:46.448421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c89fb335-ff5e-4b6f-b616-d92c87deecf0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092401 Feb 21 01:08:46.448982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1064/1943] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:46 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:46.904668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:46.905709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:46.916467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:46.917213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:46.918491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:46.919282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:46.978134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:46.986957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:46.988440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:46.989608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-44e41846-d6a7-40ee-b6d1-a8cd078bcfd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091310 Feb 21 01:08:46.990170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 880/1944] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:46 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:47.039366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d2c0adfa-1ab1-4c47-9787-b54bb2939464 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:47.040099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d2c0adfa-1ab1-4c47-9787-b54bb2939464 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:47.046803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d2c0adfa-1ab1-4c47-9787-b54bb2939464 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:47.047207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d2c0adfa-1ab1-4c47-9787-b54bb2939464 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:47.048122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d2c0adfa-1ab1-4c47-9787-b54bb2939464 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:47.049990 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d2c0adfa-1ab1-4c47-9787-b54bb2939464 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:47.190483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d2c0adfa-1ab1-4c47-9787-b54bb2939464 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:47.198384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d2c0adfa-1ab1-4c47-9787-b54bb2939464 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162694 Feb 21 01:08:47.198946 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1065/1945] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:47 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:47.469370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1e060022-1289-4e9e-922a-1cd264d63a11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:47.470055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1e060022-1289-4e9e-922a-1cd264d63a11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:47.478250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e060022-1289-4e9e-922a-1cd264d63a11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:47.478851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e060022-1289-4e9e-922a-1cd264d63a11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:47.479886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e060022-1289-4e9e-922a-1cd264d63a11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:47.480474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e060022-1289-4e9e-922a-1cd264d63a11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:47.548607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1e060022-1289-4e9e-922a-1cd264d63a11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:47.556727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1e060022-1289-4e9e-922a-1cd264d63a11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092170 Feb 21 01:08:47.557574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 881/1946] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:47 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:48.017356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:48.018454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:48.028945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:48.029384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:48.030159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:48.030613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:48.105708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:48.118146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:48.120014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:48.121887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-68ed4372-8124-4aa0-ae5d-d1c0cba81d8b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.110642 Feb 21 01:08:48.122730 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1066/1947] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:48 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:48.219645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f42df543-dd54-448a-92a8-d3020c2bfc13 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:48.220786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f42df543-dd54-448a-92a8-d3020c2bfc13 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:48.231709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f42df543-dd54-448a-92a8-d3020c2bfc13 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:48.232449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f42df543-dd54-448a-92a8-d3020c2bfc13 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:48.233807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f42df543-dd54-448a-92a8-d3020c2bfc13 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:48.234524 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f42df543-dd54-448a-92a8-d3020c2bfc13 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:48.370030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f42df543-dd54-448a-92a8-d3020c2bfc13 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:48.381580 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f42df543-dd54-448a-92a8-d3020c2bfc13 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168192 Feb 21 01:08:48.382376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 882/1948] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:48 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:48.574691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-89ed7081-4806-4f78-b02e-c3770cf9cf50 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:48.575237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-89ed7081-4806-4f78-b02e-c3770cf9cf50 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:48.581752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89ed7081-4806-4f78-b02e-c3770cf9cf50 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:48.582203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89ed7081-4806-4f78-b02e-c3770cf9cf50 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:48.582983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89ed7081-4806-4f78-b02e-c3770cf9cf50 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:48.583412 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-89ed7081-4806-4f78-b02e-c3770cf9cf50 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:48.643243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-89ed7081-4806-4f78-b02e-c3770cf9cf50 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:48.651768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-89ed7081-4806-4f78-b02e-c3770cf9cf50 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081233 Feb 21 01:08:48.652333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1067/1949] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:48 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:49.142697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:49.143414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:49.151308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:49.151836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:49.152796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:49.153300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:49.379987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:49.388618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:49.390169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:49.391305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a571c543-c7f0-4166-8c95-5c6f1d75da9d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.253845 Feb 21 01:08:49.391831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 883/1950] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:49 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:49.399399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d93a6451-fb21-4ea5-ab4e-7407c396312b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:49.400077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d93a6451-fb21-4ea5-ab4e-7407c396312b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:49.406824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d93a6451-fb21-4ea5-ab4e-7407c396312b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:49.407270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d93a6451-fb21-4ea5-ab4e-7407c396312b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:49.408039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d93a6451-fb21-4ea5-ab4e-7407c396312b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:49.408518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d93a6451-fb21-4ea5-ab4e-7407c396312b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:49.547732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d93a6451-fb21-4ea5-ab4e-7407c396312b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:49.555605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d93a6451-fb21-4ea5-ab4e-7407c396312b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160300 Feb 21 01:08:49.556192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1068/1951] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:49 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:49.671958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ae7aac2f-3bda-4a38-b8e2-e3e1ee63c2e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:49.672906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ae7aac2f-3bda-4a38-b8e2-e3e1ee63c2e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:49.683063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7aac2f-3bda-4a38-b8e2-e3e1ee63c2e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:49.683799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7aac2f-3bda-4a38-b8e2-e3e1ee63c2e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:49.685128 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7aac2f-3bda-4a38-b8e2-e3e1ee63c2e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:49.685834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ae7aac2f-3bda-4a38-b8e2-e3e1ee63c2e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:49.746902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ae7aac2f-3bda-4a38-b8e2-e3e1ee63c2e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:49.755089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ae7aac2f-3bda-4a38-b8e2-e3e1ee63c2e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089562 Feb 21 01:08:49.755647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 884/1952] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:49 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:50.413289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:50.414271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:50.424878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:50.425617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:50.426880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:50.427582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:50.494295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:50.504419 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:50.505936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:50.507054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e1e75b5f-4b62-4995-b433-21afada4f383 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.100008 Feb 21 01:08:50.507604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1069/1953] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:50 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:50.575911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1cabdde9-ecdf-4626-9f12-59bb31bdf6cd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:50.576563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1cabdde9-ecdf-4626-9f12-59bb31bdf6cd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:50.586116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cabdde9-ecdf-4626-9f12-59bb31bdf6cd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:50.586694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cabdde9-ecdf-4626-9f12-59bb31bdf6cd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:50.587781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cabdde9-ecdf-4626-9f12-59bb31bdf6cd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:50.588459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1cabdde9-ecdf-4626-9f12-59bb31bdf6cd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:50.730114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1cabdde9-ecdf-4626-9f12-59bb31bdf6cd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:50.738291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1cabdde9-ecdf-4626-9f12-59bb31bdf6cd tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168246 Feb 21 01:08:50.738836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 885/1954] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:50 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:50.774461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ad242639-69a6-493f-bd98-c683fa24fb60 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:50.775283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ad242639-69a6-493f-bd98-c683fa24fb60 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:50.783384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad242639-69a6-493f-bd98-c683fa24fb60 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:50.783963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad242639-69a6-493f-bd98-c683fa24fb60 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:50.785215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad242639-69a6-493f-bd98-c683fa24fb60 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:50.785769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad242639-69a6-493f-bd98-c683fa24fb60 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:50.846243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ad242639-69a6-493f-bd98-c683fa24fb60 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:50.854538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ad242639-69a6-493f-bd98-c683fa24fb60 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086013 Feb 21 01:08:50.855103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1070/1955] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:50 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:51.530037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:51.531187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:51.541183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:51.541912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:51.543190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:51.543897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:51.617017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:51.625618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:51.627087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:51.628208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c6b343ec-f328-47a4-8a09-3a1baf058ee5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.105484 Feb 21 01:08:51.628780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 886/1956] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:51 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:51.765395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-81673529-92fc-42fd-9d69-578f061020a8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:51.766396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-81673529-92fc-42fd-9d69-578f061020a8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:51.777770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81673529-92fc-42fd-9d69-578f061020a8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:51.778410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81673529-92fc-42fd-9d69-578f061020a8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:51.779688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81673529-92fc-42fd-9d69-578f061020a8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:51.780381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81673529-92fc-42fd-9d69-578f061020a8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:51.871228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a7d19382-c5bf-4b3b-b517-ddf84a372316 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:51.871948 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a7d19382-c5bf-4b3b-b517-ddf84a372316 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:51.878591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7d19382-c5bf-4b3b-b517-ddf84a372316 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:51.879040 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7d19382-c5bf-4b3b-b517-ddf84a372316 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:51.879822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7d19382-c5bf-4b3b-b517-ddf84a372316 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:51.880262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a7d19382-c5bf-4b3b-b517-ddf84a372316 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:51.929925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-81673529-92fc-42fd-9d69-578f061020a8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:51.938698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-81673529-92fc-42fd-9d69-578f061020a8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.179358 Feb 21 01:08:51.939194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1071/1957] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:51 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:08:51.940820 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a7d19382-c5bf-4b3b-b517-ddf84a372316 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:51.949269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a7d19382-c5bf-4b3b-b517-ddf84a372316 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081753 Feb 21 01:08:51.949824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 887/1958] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:51 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:52.651012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:52.651775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:52.659047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:52.659488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:52.660269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:52.660715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:52.722742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:52.731198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:52.732713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:52.733870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fab8b4a9-8a7f-4bf7-9a6b-a09815f4245a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087929 Feb 21 01:08:52.734424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1072/1959] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:52 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:52.959338 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bb8ac4b2-7c7c-419b-a688-4c79226c10c5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:52.960231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bb8ac4b2-7c7c-419b-a688-4c79226c10c5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:52.969432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9adf8b8b-c31f-426b-be9e-0355967669c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:52.970491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9adf8b8b-c31f-426b-be9e-0355967669c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:52.970892 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb8ac4b2-7c7c-419b-a688-4c79226c10c5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:52.971630 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb8ac4b2-7c7c-419b-a688-4c79226c10c5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:52.972957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb8ac4b2-7c7c-419b-a688-4c79226c10c5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:52.973664 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bb8ac4b2-7c7c-419b-a688-4c79226c10c5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:52.980194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9adf8b8b-c31f-426b-be9e-0355967669c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:52.980980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9adf8b8b-c31f-426b-be9e-0355967669c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:52.982272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9adf8b8b-c31f-426b-be9e-0355967669c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:52.982979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9adf8b8b-c31f-426b-be9e-0355967669c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:53.042157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9adf8b8b-c31f-426b-be9e-0355967669c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:53.052878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9adf8b8b-c31f-426b-be9e-0355967669c3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089203 Feb 21 01:08:53.053416 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1073/1960] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:52 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:53.113053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bb8ac4b2-7c7c-419b-a688-4c79226c10c5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:53.125113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bb8ac4b2-7c7c-419b-a688-4c79226c10c5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172217 Feb 21 01:08:53.125904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 888/1961] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:52 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:53.755019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:53.756052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:53.766172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:53.766618 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:53.767400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:53.767826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:53.833186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:53.841602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:53.843095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:53.844279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-df52fdc0-0f48-4ae3-a0bf-6733f82d0a9a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095607 Feb 21 01:08:53.844877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1074/1962] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:53 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:54.073039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c4e36e21-b2bb-47db-b60b-80db0e72bdc2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:54.074016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c4e36e21-b2bb-47db-b60b-80db0e72bdc2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:54.084059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c4e36e21-b2bb-47db-b60b-80db0e72bdc2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:54.084709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c4e36e21-b2bb-47db-b60b-80db0e72bdc2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:54.085887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c4e36e21-b2bb-47db-b60b-80db0e72bdc2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:54.086535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c4e36e21-b2bb-47db-b60b-80db0e72bdc2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:54.148970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3dc0ed68-e05d-400e-96e5-da1f98dd0c9e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:54.149576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3dc0ed68-e05d-400e-96e5-da1f98dd0c9e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:54.150480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c4e36e21-b2bb-47db-b60b-80db0e72bdc2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:54.156295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dc0ed68-e05d-400e-96e5-da1f98dd0c9e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:54.156771 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dc0ed68-e05d-400e-96e5-da1f98dd0c9e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:54.157535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dc0ed68-e05d-400e-96e5-da1f98dd0c9e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:54.157958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3dc0ed68-e05d-400e-96e5-da1f98dd0c9e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:54.159158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c4e36e21-b2bb-47db-b60b-80db0e72bdc2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091969 Feb 21 01:08:54.159732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 889/1963] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:54 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:54.290916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3dc0ed68-e05d-400e-96e5-da1f98dd0c9e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:54.303594 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3dc0ed68-e05d-400e-96e5-da1f98dd0c9e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158338 Feb 21 01:08:54.304815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1075/1964] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:54 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:08:54.864731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:54.865647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:54.874515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:54.875044 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:54.875896 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:54.876327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:54.936011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:54.945066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:54.946544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:54.947712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9ab94cc1-df58-4929-ab23-72668c878ec9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088923 Feb 21 01:08:54.948257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 890/1965] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:54 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:55.180038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce59dc17-f19b-4e8b-8300-c8cda913efe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:55.180967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce59dc17-f19b-4e8b-8300-c8cda913efe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:55.191715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce59dc17-f19b-4e8b-8300-c8cda913efe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:55.192463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce59dc17-f19b-4e8b-8300-c8cda913efe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:55.193755 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce59dc17-f19b-4e8b-8300-c8cda913efe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:55.194465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce59dc17-f19b-4e8b-8300-c8cda913efe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:55.261939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce59dc17-f19b-4e8b-8300-c8cda913efe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:55.270325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce59dc17-f19b-4e8b-8300-c8cda913efe0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096469 Feb 21 01:08:55.270885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1076/1966] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:55 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:55.323882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-707ba99b-1c0b-4c0b-ab6c-81a59d8425d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:55.324482 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-707ba99b-1c0b-4c0b-ab6c-81a59d8425d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:55.331166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-707ba99b-1c0b-4c0b-ab6c-81a59d8425d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:55.331608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-707ba99b-1c0b-4c0b-ab6c-81a59d8425d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:55.332373 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-707ba99b-1c0b-4c0b-ab6c-81a59d8425d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:55.332831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-707ba99b-1c0b-4c0b-ab6c-81a59d8425d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:55.478940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-707ba99b-1c0b-4c0b-ab6c-81a59d8425d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:55.491386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-707ba99b-1c0b-4c0b-ab6c-81a59d8425d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.170905 Feb 21 01:08:55.492079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 891/1967] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:55 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:55.969470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:55.970395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:55.980561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:55.981284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:55.982491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:55.983159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:56.055059 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:56.063400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:56.064887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:56.066003 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c09e994d-1df9-4d91-bac2-cd82dc9a11b4 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.102998 Feb 21 01:08:56.066557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1077/1968] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:55 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:56.291196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0121da68-9316-4324-93b9-76b1e44d6539 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:56.292208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0121da68-9316-4324-93b9-76b1e44d6539 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:56.302397 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0121da68-9316-4324-93b9-76b1e44d6539 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:56.303139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0121da68-9316-4324-93b9-76b1e44d6539 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:56.304477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0121da68-9316-4324-93b9-76b1e44d6539 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:56.305223 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0121da68-9316-4324-93b9-76b1e44d6539 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:56.368219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0121da68-9316-4324-93b9-76b1e44d6539 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:56.376631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0121da68-9316-4324-93b9-76b1e44d6539 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091557 Feb 21 01:08:56.377210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 892/1969] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:56 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:56.511977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a40fb1ab-a4ce-4579-a69e-a45d1e4f1a0e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:56.513190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a40fb1ab-a4ce-4579-a69e-a45d1e4f1a0e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:56.524323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a40fb1ab-a4ce-4579-a69e-a45d1e4f1a0e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:56.525131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a40fb1ab-a4ce-4579-a69e-a45d1e4f1a0e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:56.526397 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a40fb1ab-a4ce-4579-a69e-a45d1e4f1a0e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:56.527102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a40fb1ab-a4ce-4579-a69e-a45d1e4f1a0e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:56.662266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a40fb1ab-a4ce-4579-a69e-a45d1e4f1a0e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:56.670202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a40fb1ab-a4ce-4579-a69e-a45d1e4f1a0e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164340 Feb 21 01:08:56.670796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1078/1970] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:56 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:57.083143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:57.083792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:57.089844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:57.090291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:57.091064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:57.091495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:57.151053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:57.159631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:57.161169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:57.162332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-55246cfd-b96d-4ce0-ad0d-6ea0249fdc58 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.082962 Feb 21 01:08:57.162863 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 893/1971] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:57 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:57.398095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dfa99d23-8f53-4685-bd6e-4b711e2a6a42 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:57.398973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dfa99d23-8f53-4685-bd6e-4b711e2a6a42 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:57.410262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dfa99d23-8f53-4685-bd6e-4b711e2a6a42 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:57.411082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dfa99d23-8f53-4685-bd6e-4b711e2a6a42 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:57.412540 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dfa99d23-8f53-4685-bd6e-4b711e2a6a42 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:57.413287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dfa99d23-8f53-4685-bd6e-4b711e2a6a42 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:57.487057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dfa99d23-8f53-4685-bd6e-4b711e2a6a42 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:57.495164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dfa99d23-8f53-4685-bd6e-4b711e2a6a42 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.103777 Feb 21 01:08:57.495757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1079/1972] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:57 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:57.690891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-eb855348-e141-440a-8446-3020c925feb4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:57.691741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-eb855348-e141-440a-8446-3020c925feb4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:57.702224 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eb855348-e141-440a-8446-3020c925feb4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:57.702963 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eb855348-e141-440a-8446-3020c925feb4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:57.703934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eb855348-e141-440a-8446-3020c925feb4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:57.704356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-eb855348-e141-440a-8446-3020c925feb4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:57.848644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-eb855348-e141-440a-8446-3020c925feb4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:57.860547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-eb855348-e141-440a-8446-3020c925feb4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.175614 Feb 21 01:08:57.861121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 894/1973] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:57 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:58.180014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:58.180666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:58.187233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:58.187673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:58.188425 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:58.188887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:58.251350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:58.259951 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:58.261461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:58.262580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6e53abfe-070d-415b-b587-9c2cd56f1bdc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086303 Feb 21 01:08:58.263133 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1080/1974] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:58 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:58.516972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bfdad0b3-3091-4744-8161-3587b92ea085 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:58.517963 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bfdad0b3-3091-4744-8161-3587b92ea085 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:58.528661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfdad0b3-3091-4744-8161-3587b92ea085 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:58.529394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfdad0b3-3091-4744-8161-3587b92ea085 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:58.531249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfdad0b3-3091-4744-8161-3587b92ea085 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:58.531403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfdad0b3-3091-4744-8161-3587b92ea085 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:58.593398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bfdad0b3-3091-4744-8161-3587b92ea085 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:58.601842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bfdad0b3-3091-4744-8161-3587b92ea085 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091862 Feb 21 01:08:58.602423 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 895/1975] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:58 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:58.881688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a41c235f-3392-48d8-8992-f878a61ed5e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:58.882697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a41c235f-3392-48d8-8992-f878a61ed5e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:58.892337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a41c235f-3392-48d8-8992-f878a61ed5e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:58.892814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a41c235f-3392-48d8-8992-f878a61ed5e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:58.893584 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a41c235f-3392-48d8-8992-f878a61ed5e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:58.894017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a41c235f-3392-48d8-8992-f878a61ed5e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:59.036168 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a41c235f-3392-48d8-8992-f878a61ed5e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:59.044543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a41c235f-3392-48d8-8992-f878a61ed5e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169124 Feb 21 01:08:59.045091 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1081/1976] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:58 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:08:59.284915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:59.285918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:59.296051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:59.296912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:59.298191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:59.298951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:59.365218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:59.374206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:59.375795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:59.376970 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7373b19d-7296-409b-8994-765c7077b799 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.098563 Feb 21 01:08:59.377520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 896/1977] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:08:59 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:08:59.622566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4d3bf7cb-f28f-4b76-839e-cbbb78ebf074 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:08:59.623417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4d3bf7cb-f28f-4b76-839e-cbbb78ebf074 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:08:59.634220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7cb-f28f-4b76-839e-cbbb78ebf074 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:59.634966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7cb-f28f-4b76-839e-cbbb78ebf074 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:59.636250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7cb-f28f-4b76-839e-cbbb78ebf074 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:08:59.637031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d3bf7cb-f28f-4b76-839e-cbbb78ebf074 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:08:59.708268 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4d3bf7cb-f28f-4b76-839e-cbbb78ebf074 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:08:59.720600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4d3bf7cb-f28f-4b76-839e-cbbb78ebf074 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.104018 Feb 21 01:08:59.721378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1082/1978] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:08:59 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:00.064528 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-acb8084e-fbbb-423e-b46a-b44a1b6c610e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:00.065212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-acb8084e-fbbb-423e-b46a-b44a1b6c610e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:00.072793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-acb8084e-fbbb-423e-b46a-b44a1b6c610e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:00.073293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-acb8084e-fbbb-423e-b46a-b44a1b6c610e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:00.074166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-acb8084e-fbbb-423e-b46a-b44a1b6c610e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:00.074647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-acb8084e-fbbb-423e-b46a-b44a1b6c610e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:00.213590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-acb8084e-fbbb-423e-b46a-b44a1b6c610e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:00.222012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-acb8084e-fbbb-423e-b46a-b44a1b6c610e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163119 Feb 21 01:09:00.222649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 897/1979] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:00 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:00.399235 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:00.400162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:00.410190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:00.410941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:00.412224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:00.413007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:00.482169 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:00.491323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:00.492876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:00.494011 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1222c22b-a07a-49b7-95c0-571c92f2d6ce tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.101466 Feb 21 01:09:00.494575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1083/1980] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:00 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:00.740861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-24bf4ae8-fd19-4d65-b48f-7fe574f217e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:00.741829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-24bf4ae8-fd19-4d65-b48f-7fe574f217e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:00.751485 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-24bf4ae8-fd19-4d65-b48f-7fe574f217e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:00.751926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-24bf4ae8-fd19-4d65-b48f-7fe574f217e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:00.752731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-24bf4ae8-fd19-4d65-b48f-7fe574f217e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:00.753157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-24bf4ae8-fd19-4d65-b48f-7fe574f217e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:00.816297 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-24bf4ae8-fd19-4d65-b48f-7fe574f217e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:00.824307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-24bf4ae8-fd19-4d65-b48f-7fe574f217e8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089665 Feb 21 01:09:00.824902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 898/1981] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:00 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:01.241154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-309a0828-ca2f-40e9-bb11-c3a6d602674c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:01.241858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-309a0828-ca2f-40e9-bb11-c3a6d602674c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:01.249795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-309a0828-ca2f-40e9-bb11-c3a6d602674c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:01.250313 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-309a0828-ca2f-40e9-bb11-c3a6d602674c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:01.251229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-309a0828-ca2f-40e9-bb11-c3a6d602674c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:01.251745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-309a0828-ca2f-40e9-bb11-c3a6d602674c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:01.387451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-309a0828-ca2f-40e9-bb11-c3a6d602674c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:01.395357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-309a0828-ca2f-40e9-bb11-c3a6d602674c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158784 Feb 21 01:09:01.396432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1084/1982] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:01 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:01.514203 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:01.515033 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:01.523602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:01.524047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:01.524864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:01.525277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:01.588857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:01.597774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:01.599245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:01.600409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6a8614ad-2e3e-43db-9385-4bea6a5d1b70 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091738 Feb 21 01:09:01.600970 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 899/1983] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:01 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:01.846304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-099805ab-0a64-4207-84ea-b45b64bc5a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:01.848182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-099805ab-0a64-4207-84ea-b45b64bc5a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:01.860881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-099805ab-0a64-4207-84ea-b45b64bc5a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:01.862217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-099805ab-0a64-4207-84ea-b45b64bc5a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:01.863070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-099805ab-0a64-4207-84ea-b45b64bc5a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:01.863500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-099805ab-0a64-4207-84ea-b45b64bc5a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:01.926742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-099805ab-0a64-4207-84ea-b45b64bc5a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:01.934804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-099805ab-0a64-4207-84ea-b45b64bc5a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096527 Feb 21 01:09:01.935374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1085/1984] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:01 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:02.417076 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-816cfd95-f19f-4127-b818-306b8bde8220 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:02.418049 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-816cfd95-f19f-4127-b818-306b8bde8220 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:02.428430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-816cfd95-f19f-4127-b818-306b8bde8220 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:02.429242 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-816cfd95-f19f-4127-b818-306b8bde8220 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:02.430519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-816cfd95-f19f-4127-b818-306b8bde8220 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:02.431227 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-816cfd95-f19f-4127-b818-306b8bde8220 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:02.570562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-816cfd95-f19f-4127-b818-306b8bde8220 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:02.578788 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-816cfd95-f19f-4127-b818-306b8bde8220 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168097 Feb 21 01:09:02.579379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 900/1985] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:02 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:02.618153 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:02.618728 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:02.625195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:02.625639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:02.626391 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:02.626811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:02.686757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:02.695386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:02.696906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:02.698037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-15d63aff-fece-4251-81c2-59c968a64ca8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083606 Feb 21 01:09:02.698599 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1086/1986] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:02 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:02.955682 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-542398ea-d0ed-4ae4-98f4-207536daaccc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:02.956604 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-542398ea-d0ed-4ae4-98f4-207536daaccc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:02.966576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-542398ea-d0ed-4ae4-98f4-207536daaccc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:02.967314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-542398ea-d0ed-4ae4-98f4-207536daaccc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:02.968631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-542398ea-d0ed-4ae4-98f4-207536daaccc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:02.969337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-542398ea-d0ed-4ae4-98f4-207536daaccc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:03.047853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-542398ea-d0ed-4ae4-98f4-207536daaccc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:03.058665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-542398ea-d0ed-4ae4-98f4-207536daaccc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.109160 Feb 21 01:09:03.059278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 901/1987] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:02 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:03.597251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5f47c4ec-0203-4812-b1c3-d39a6a415800 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:03.597966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5f47c4ec-0203-4812-b1c3-d39a6a415800 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:03.606497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f47c4ec-0203-4812-b1c3-d39a6a415800 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:03.607062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f47c4ec-0203-4812-b1c3-d39a6a415800 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:03.608156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f47c4ec-0203-4812-b1c3-d39a6a415800 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:03.608741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5f47c4ec-0203-4812-b1c3-d39a6a415800 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:03.715207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:03.715796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:03.723084 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:03.723529 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:03.724340 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:03.724804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:03.753333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5f47c4ec-0203-4812-b1c3-d39a6a415800 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:03.763686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5f47c4ec-0203-4812-b1c3-d39a6a415800 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171413 Feb 21 01:09:03.764470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1087/1988] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:03 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:03.790927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:03.800552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:03.802026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:03.803260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5b4fbf33-418f-43ef-96e7-8c22fbe870fc tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091865 Feb 21 01:09:03.803846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 902/1989] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:03 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:04.079305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ce32f9a2-6c67-4efe-941c-58c8594bea9c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:04.080183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ce32f9a2-6c67-4efe-941c-58c8594bea9c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:04.087271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce32f9a2-6c67-4efe-941c-58c8594bea9c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:04.087706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce32f9a2-6c67-4efe-941c-58c8594bea9c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:04.088521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce32f9a2-6c67-4efe-941c-58c8594bea9c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:04.088947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ce32f9a2-6c67-4efe-941c-58c8594bea9c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:04.163423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ce32f9a2-6c67-4efe-941c-58c8594bea9c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:04.175407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ce32f9a2-6c67-4efe-941c-58c8594bea9c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.102566 Feb 21 01:09:04.175983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1088/1990] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:04 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:04.785688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0bd2d054-51f5-4b49-b338-9984409a4a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:04.786514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0bd2d054-51f5-4b49-b338-9984409a4a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:04.797242 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0bd2d054-51f5-4b49-b338-9984409a4a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:04.797977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0bd2d054-51f5-4b49-b338-9984409a4a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:04.799255 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0bd2d054-51f5-4b49-b338-9984409a4a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:04.799946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0bd2d054-51f5-4b49-b338-9984409a4a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:04.820255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:04.820900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:04.827271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:04.827709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:04.828512 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:04.828925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:04.888562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:04.897616 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:04.899096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:04.900220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-558f926b-2bdc-4fd9-8153-8b90cf96a5ac tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.083702 Feb 21 01:09:04.900815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1089/1991] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:04 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:04.932763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0bd2d054-51f5-4b49-b338-9984409a4a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:04.944309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0bd2d054-51f5-4b49-b338-9984409a4a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164715 Feb 21 01:09:04.945104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 903/1992] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:04 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:05.196667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-64f477f5-f4d2-4906-8457-7f82a4009de3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:05.197591 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-64f477f5-f4d2-4906-8457-7f82a4009de3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:05.207840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64f477f5-f4d2-4906-8457-7f82a4009de3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:05.208637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64f477f5-f4d2-4906-8457-7f82a4009de3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:05.209955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64f477f5-f4d2-4906-8457-7f82a4009de3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:05.210682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-64f477f5-f4d2-4906-8457-7f82a4009de3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:05.278446 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-64f477f5-f4d2-4906-8457-7f82a4009de3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:05.287246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-64f477f5-f4d2-4906-8457-7f82a4009de3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096966 Feb 21 01:09:05.287827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1090/1993] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:05 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:05.919048 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:05.919663 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:05.926659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:05.927102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:05.927869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:05.928295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:05.965508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-065c961f-1300-42d4-8759-0fbbda672b32 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:05.966079 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-065c961f-1300-42d4-8759-0fbbda672b32 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:05.972841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-065c961f-1300-42d4-8759-0fbbda672b32 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:05.973255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-065c961f-1300-42d4-8759-0fbbda672b32 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:05.974036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-065c961f-1300-42d4-8759-0fbbda672b32 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:05.974463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-065c961f-1300-42d4-8759-0fbbda672b32 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:05.989547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:05.998199 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:05.999675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:06.000830 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-286b0d58-047e-4ed8-b3e4-3e26ed9917e1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085661 Feb 21 01:09:06.001382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 904/1994] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:05 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:06.106194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-065c961f-1300-42d4-8759-0fbbda672b32 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:06.114208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-065c961f-1300-42d4-8759-0fbbda672b32 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.152385 Feb 21 01:09:06.114775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1091/1995] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:05 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:06.304957 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b990e155-4abb-4d01-bd98-8795ce76d0bb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:06.305562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b990e155-4abb-4d01-bd98-8795ce76d0bb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:06.312120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b990e155-4abb-4d01-bd98-8795ce76d0bb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:06.312603 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b990e155-4abb-4d01-bd98-8795ce76d0bb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:06.313369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b990e155-4abb-4d01-bd98-8795ce76d0bb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:06.313816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b990e155-4abb-4d01-bd98-8795ce76d0bb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:06.375954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b990e155-4abb-4d01-bd98-8795ce76d0bb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:06.383891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b990e155-4abb-4d01-bd98-8795ce76d0bb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082992 Feb 21 01:09:06.384483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 905/1996] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:06 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:07.021602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:07.022226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:07.029321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:07.029787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:07.030617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:07.031067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:07.092625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:07.100976 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:07.102463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:07.103583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-96ce0967-1d59-4de8-bcda-b72c1bafe96f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087156 Feb 21 01:09:07.104143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1092/1997] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:07 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:07.133721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e1bf715e-6b49-48fe-8910-8f2fd4bfaa33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:07.134331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e1bf715e-6b49-48fe-8910-8f2fd4bfaa33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:07.144112 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1bf715e-6b49-48fe-8910-8f2fd4bfaa33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:07.144590 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1bf715e-6b49-48fe-8910-8f2fd4bfaa33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:07.145359 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1bf715e-6b49-48fe-8910-8f2fd4bfaa33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:07.145784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1bf715e-6b49-48fe-8910-8f2fd4bfaa33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:07.302774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e1bf715e-6b49-48fe-8910-8f2fd4bfaa33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:07.315407 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e1bf715e-6b49-48fe-8910-8f2fd4bfaa33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.187373 Feb 21 01:09:07.316278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 906/1998] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:07 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:07.404939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-52b51bf3-6d54-4b55-a8c8-6325a7ad71f4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:07.405866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-52b51bf3-6d54-4b55-a8c8-6325a7ad71f4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:07.413658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52b51bf3-6d54-4b55-a8c8-6325a7ad71f4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:07.414184 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52b51bf3-6d54-4b55-a8c8-6325a7ad71f4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:07.414992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52b51bf3-6d54-4b55-a8c8-6325a7ad71f4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:07.415432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52b51bf3-6d54-4b55-a8c8-6325a7ad71f4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:07.479640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-52b51bf3-6d54-4b55-a8c8-6325a7ad71f4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:07.489703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-52b51bf3-6d54-4b55-a8c8-6325a7ad71f4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090673 Feb 21 01:09:07.490571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1093/1999] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:07 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:08.123479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:08.124277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:08.131473 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:08.131914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:08.132744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:08.133158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:08.205981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:08.218736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:08.221093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:08.222345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-81798656-67f6-4373-bf74-8c3f77b93b9c tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103917 Feb 21 01:09:08.222906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 907/2000] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:08 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:08.340878 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e3f27872-6de5-4229-9281-7ec001fbade2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:08.341505 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e3f27872-6de5-4229-9281-7ec001fbade2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:08.349557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3f27872-6de5-4229-9281-7ec001fbade2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:08.350006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3f27872-6de5-4229-9281-7ec001fbade2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:08.350786 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3f27872-6de5-4229-9281-7ec001fbade2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:08.351216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e3f27872-6de5-4229-9281-7ec001fbade2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:08.486426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e3f27872-6de5-4229-9281-7ec001fbade2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:08.494850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e3f27872-6de5-4229-9281-7ec001fbade2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159779 Feb 21 01:09:08.495435 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1094/2001] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:08 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:08.510976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-995dae62-dc56-4403-a7da-ebf6d029dfe5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:08.511632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-995dae62-dc56-4403-a7da-ebf6d029dfe5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:08.518488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-995dae62-dc56-4403-a7da-ebf6d029dfe5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:08.518937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-995dae62-dc56-4403-a7da-ebf6d029dfe5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:08.519750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-995dae62-dc56-4403-a7da-ebf6d029dfe5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:08.520380 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-995dae62-dc56-4403-a7da-ebf6d029dfe5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:08.587265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-995dae62-dc56-4403-a7da-ebf6d029dfe5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:08.595931 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-995dae62-dc56-4403-a7da-ebf6d029dfe5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088617 Feb 21 01:09:08.596555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 908/2002] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:08 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:09.244094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:09.245131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:09.254361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:09.254779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:09.255560 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:09.255986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:09.322507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:09.331023 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:09.332504 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:09.333627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ba43aa97-7e53-455a-a467-125264084bc5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095902 Feb 21 01:09:09.334174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1095/2003] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:09 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:09.515806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1a1fd17b-2ed3-45f5-bf32-bb37cbb9ecfa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:09.516765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1a1fd17b-2ed3-45f5-bf32-bb37cbb9ecfa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:09.524929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a1fd17b-2ed3-45f5-bf32-bb37cbb9ecfa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:09.525413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a1fd17b-2ed3-45f5-bf32-bb37cbb9ecfa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:09.526281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a1fd17b-2ed3-45f5-bf32-bb37cbb9ecfa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:09.527256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1a1fd17b-2ed3-45f5-bf32-bb37cbb9ecfa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:09.614041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f581db1f-7844-42de-8ad2-d9ea7f99cc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:09.614668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f581db1f-7844-42de-8ad2-d9ea7f99cc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:09.621213 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f581db1f-7844-42de-8ad2-d9ea7f99cc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:09.621655 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f581db1f-7844-42de-8ad2-d9ea7f99cc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:09.622423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f581db1f-7844-42de-8ad2-d9ea7f99cc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:09.622848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f581db1f-7844-42de-8ad2-d9ea7f99cc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:09.667814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1a1fd17b-2ed3-45f5-bf32-bb37cbb9ecfa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:09.675855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1a1fd17b-2ed3-45f5-bf32-bb37cbb9ecfa tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166267 Feb 21 01:09:09.676456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 909/2004] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:09 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:09.688125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f581db1f-7844-42de-8ad2-d9ea7f99cc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:09.696205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f581db1f-7844-42de-8ad2-d9ea7f99cc34 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086699 Feb 21 01:09:09.696792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1096/2005] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:09 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:10.355436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:10.356487 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:10.364991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:10.365431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:10.366204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:10.366631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:10.431222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:10.439809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:10.441393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:10.442536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-257e368e-7338-4893-81f4-a88112a778c1 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093582 Feb 21 01:09:10.443092 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 910/2006] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:10 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:10.696926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c31e9a90-47f0-4985-96b2-7df3a4740a26 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:10.697784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c31e9a90-47f0-4985-96b2-7df3a4740a26 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:10.708277 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c31e9a90-47f0-4985-96b2-7df3a4740a26 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:10.709034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c31e9a90-47f0-4985-96b2-7df3a4740a26 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:10.710332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c31e9a90-47f0-4985-96b2-7df3a4740a26 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:10.711040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c31e9a90-47f0-4985-96b2-7df3a4740a26 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:10.716654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e743e6e6-47c0-49c0-9d9e-3fee0b73e6f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:10.717663 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e743e6e6-47c0-49c0-9d9e-3fee0b73e6f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:10.726189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e743e6e6-47c0-49c0-9d9e-3fee0b73e6f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:10.726680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e743e6e6-47c0-49c0-9d9e-3fee0b73e6f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:10.727490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e743e6e6-47c0-49c0-9d9e-3fee0b73e6f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:10.727932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e743e6e6-47c0-49c0-9d9e-3fee0b73e6f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:10.787251 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e743e6e6-47c0-49c0-9d9e-3fee0b73e6f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:10.794993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e743e6e6-47c0-49c0-9d9e-3fee0b73e6f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084354 Feb 21 01:09:10.795562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 911/2007] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:10 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:10.850988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c31e9a90-47f0-4985-96b2-7df3a4740a26 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:10.859553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c31e9a90-47f0-4985-96b2-7df3a4740a26 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168914 Feb 21 01:09:10.860127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1097/2008] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:10 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:11.460532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:11.461158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:11.467172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:11.467635 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:11.468441 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:11.468853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:11.532488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:11.543912 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:11.546329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:11.548036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dbd125fb-54db-40da-a420-656939880b77 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.091058 Feb 21 01:09:11.548838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 912/2009] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:11 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:11.815299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4b4c3679-18d2-46f8-8774-2ff3fa2255b1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:11.816266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4b4c3679-18d2-46f8-8774-2ff3fa2255b1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:11.826804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b4c3679-18d2-46f8-8774-2ff3fa2255b1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:11.827592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b4c3679-18d2-46f8-8774-2ff3fa2255b1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:11.828912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b4c3679-18d2-46f8-8774-2ff3fa2255b1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:11.829613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b4c3679-18d2-46f8-8774-2ff3fa2255b1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:11.876956 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fb015ea1-889e-46ac-b162-d8020852289e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:11.877596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fb015ea1-889e-46ac-b162-d8020852289e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:11.884493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb015ea1-889e-46ac-b162-d8020852289e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:11.884941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb015ea1-889e-46ac-b162-d8020852289e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:11.885728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb015ea1-889e-46ac-b162-d8020852289e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:11.886131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb015ea1-889e-46ac-b162-d8020852289e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:11.889595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4b4c3679-18d2-46f8-8774-2ff3fa2255b1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:11.898044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4b4c3679-18d2-46f8-8774-2ff3fa2255b1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088727 Feb 21 01:09:11.898626 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1098/2010] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:11 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:12.023377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fb015ea1-889e-46ac-b162-d8020852289e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:12.031180 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fb015ea1-889e-46ac-b162-d8020852289e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157903 Feb 21 01:09:12.031742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 913/2011] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:11 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:12.569000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:12.569742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:12.579162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:12.579737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:12.580679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:12.581233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:12.739158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:12.747575 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:12.749089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:12.750226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-394c6c7d-3403-43a1-ae08-c3a6be8c855d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.187031 Feb 21 01:09:12.750756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1099/2012] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:12 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:12.918883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c929e778-8b9d-46e3-9d0b-ed60cb46d19d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:12.919736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c929e778-8b9d-46e3-9d0b-ed60cb46d19d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:12.930218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c929e778-8b9d-46e3-9d0b-ed60cb46d19d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:12.930951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c929e778-8b9d-46e3-9d0b-ed60cb46d19d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:12.932218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c929e778-8b9d-46e3-9d0b-ed60cb46d19d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:12.932983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c929e778-8b9d-46e3-9d0b-ed60cb46d19d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.048600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a7f91f6e-e492-454d-9043-7e66c54dea99 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:13.049202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a7f91f6e-e492-454d-9043-7e66c54dea99 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:13.057718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7f91f6e-e492-454d-9043-7e66c54dea99 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:13.058166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7f91f6e-e492-454d-9043-7e66c54dea99 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.058950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7f91f6e-e492-454d-9043-7e66c54dea99 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:13.059372 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a7f91f6e-e492-454d-9043-7e66c54dea99 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.059531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c929e778-8b9d-46e3-9d0b-ed60cb46d19d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:13.067852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c929e778-8b9d-46e3-9d0b-ed60cb46d19d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.155194 Feb 21 01:09:13.068440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 914/2013] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:12 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:13.201430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a7f91f6e-e492-454d-9043-7e66c54dea99 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:13.209848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a7f91f6e-e492-454d-9043-7e66c54dea99 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165287 Feb 21 01:09:13.210415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1100/2014] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:13 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:13.767780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:13.768379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:13.775456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:13.775897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.776702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:13.777117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:13.839688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:13.852616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:13.854952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:13.856640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5cc5c9d6-7bb8-400d-a2b9-ed2c8dc1c49a tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.092410 Feb 21 01:09:13.857354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 915/2015] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:13 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:14.088684 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f496ca89-a260-4939-afdc-ff6d53985e0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:14.089554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f496ca89-a260-4939-afdc-ff6d53985e0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:14.100137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f496ca89-a260-4939-afdc-ff6d53985e0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.100926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f496ca89-a260-4939-afdc-ff6d53985e0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.102187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f496ca89-a260-4939-afdc-ff6d53985e0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.102890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f496ca89-a260-4939-afdc-ff6d53985e0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.173970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f496ca89-a260-4939-afdc-ff6d53985e0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:14.182658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f496ca89-a260-4939-afdc-ff6d53985e0c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.100334 Feb 21 01:09:14.183226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1101/2016] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:14 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:14.229743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1d21b2e8-47e9-44aa-8fc9-11d43b28bdea tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:14.230658 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1d21b2e8-47e9-44aa-8fc9-11d43b28bdea tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:14.240784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d21b2e8-47e9-44aa-8fc9-11d43b28bdea tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.241897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d21b2e8-47e9-44aa-8fc9-11d43b28bdea tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.243802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d21b2e8-47e9-44aa-8fc9-11d43b28bdea tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.244808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d21b2e8-47e9-44aa-8fc9-11d43b28bdea tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.393960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d21b2e8-47e9-44aa-8fc9-11d43b28bdea tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:14.402344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1d21b2e8-47e9-44aa-8fc9-11d43b28bdea tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.178289 Feb 21 01:09:14.402898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 916/2017] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:14 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:14.876729 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:14.877533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:14.884154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.884624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.885395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:14.885823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:14.946068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:14.954904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:14.956421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:14.957742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1e81cfce-0517-45ca-88a1-386547b6e365 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.084925 Feb 21 01:09:14.958275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1102/2018] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:14 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:15.206103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-85c2c51b-c5b8-459d-885a-32a52beb7c49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:15.206969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-85c2c51b-c5b8-459d-885a-32a52beb7c49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:15.217106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85c2c51b-c5b8-459d-885a-32a52beb7c49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:15.217853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85c2c51b-c5b8-459d-885a-32a52beb7c49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:15.219117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85c2c51b-c5b8-459d-885a-32a52beb7c49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:15.219839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-85c2c51b-c5b8-459d-885a-32a52beb7c49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:15.286738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-85c2c51b-c5b8-459d-885a-32a52beb7c49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:15.294948 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-85c2c51b-c5b8-459d-885a-32a52beb7c49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095224 Feb 21 01:09:15.295488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 917/2019] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:15 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:15.423628 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c3e6854d-3d83-4bdd-8713-96a2116a30d3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:15.424673 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c3e6854d-3d83-4bdd-8713-96a2116a30d3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:15.431802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3e6854d-3d83-4bdd-8713-96a2116a30d3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:15.432244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3e6854d-3d83-4bdd-8713-96a2116a30d3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:15.433045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3e6854d-3d83-4bdd-8713-96a2116a30d3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:15.433468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c3e6854d-3d83-4bdd-8713-96a2116a30d3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:15.579947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c3e6854d-3d83-4bdd-8713-96a2116a30d3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:15.588444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c3e6854d-3d83-4bdd-8713-96a2116a30d3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.170968 Feb 21 01:09:15.589038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1103/2020] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:15 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:15.977714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:15.978352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:15.985710 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:15.986259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:15.987156 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:15.987653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:16.048213 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:16.056969 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:16.058439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:16.059571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-31c3b6f2-0ff9-45d4-889e-e6c72a41f2d7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.086389 Feb 21 01:09:16.060121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 918/2021] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:15 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:16.317417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2a5452e1-4054-4499-a2d6-8683972396e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:16.318320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2a5452e1-4054-4499-a2d6-8683972396e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:16.327912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a5452e1-4054-4499-a2d6-8683972396e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:16.328644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a5452e1-4054-4499-a2d6-8683972396e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:16.329843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a5452e1-4054-4499-a2d6-8683972396e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:16.330497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a5452e1-4054-4499-a2d6-8683972396e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:16.394501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2a5452e1-4054-4499-a2d6-8683972396e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:16.402689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2a5452e1-4054-4499-a2d6-8683972396e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091150 Feb 21 01:09:16.403256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1104/2022] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:16 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:16.609438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-91b86da8-2a6f-4a98-851e-efb2cc6ca6e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:16.610377 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-91b86da8-2a6f-4a98-851e-efb2cc6ca6e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:16.621483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91b86da8-2a6f-4a98-851e-efb2cc6ca6e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:16.622203 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91b86da8-2a6f-4a98-851e-efb2cc6ca6e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:16.623488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91b86da8-2a6f-4a98-851e-efb2cc6ca6e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:16.624205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91b86da8-2a6f-4a98-851e-efb2cc6ca6e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:16.769136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-91b86da8-2a6f-4a98-851e-efb2cc6ca6e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:16.777373 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-91b86da8-2a6f-4a98-851e-efb2cc6ca6e7 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.174361 Feb 21 01:09:16.777960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 919/2023] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:16 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:17.083699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:17.084278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:17.090724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.091157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.091915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.092337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.152842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:17.161678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:17.163160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:17.164282 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-169c37f9-bfae-4d48-b0ba-48605cb178ba tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.085786 Feb 21 01:09:17.164862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1105/2024] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:17 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:17.419490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f2cf4c0b-fbb7-4236-8162-c4e395f6c019 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:17.420050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f2cf4c0b-fbb7-4236-8162-c4e395f6c019 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:17.427025 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f2cf4c0b-fbb7-4236-8162-c4e395f6c019 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.427475 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f2cf4c0b-fbb7-4236-8162-c4e395f6c019 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.428231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f2cf4c0b-fbb7-4236-8162-c4e395f6c019 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.428709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f2cf4c0b-fbb7-4236-8162-c4e395f6c019 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.487891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f2cf4c0b-fbb7-4236-8162-c4e395f6c019 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:17.499541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f2cf4c0b-fbb7-4236-8162-c4e395f6c019 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084066 Feb 21 01:09:17.500140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 920/2025] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:17 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:17.794461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fda1e9ba-1212-4cf4-a71a-aeed363f3a75 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:17.795082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fda1e9ba-1212-4cf4-a71a-aeed363f3a75 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:17.802005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fda1e9ba-1212-4cf4-a71a-aeed363f3a75 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.802464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fda1e9ba-1212-4cf4-a71a-aeed363f3a75 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.803242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fda1e9ba-1212-4cf4-a71a-aeed363f3a75 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:17.803679 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fda1e9ba-1212-4cf4-a71a-aeed363f3a75 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:17.958032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fda1e9ba-1212-4cf4-a71a-aeed363f3a75 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:17.969351 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fda1e9ba-1212-4cf4-a71a-aeed363f3a75 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.178442 Feb 21 01:09:17.970115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1106/2026] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:17 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:18.186031 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:18.186882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:18.195438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:18.195888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:18.196701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:18.197131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:18.256547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:18.265143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:18.266641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:18.267776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-293d06ef-5521-46af-a498-c9492ffc5554 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.088136 Feb 21 01:09:18.268327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 921/2027] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:18 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:18.521198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c81a4978-6d45-4bc4-a0d8-f741d1136a39 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:18.522001 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c81a4978-6d45-4bc4-a0d8-f741d1136a39 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:18.530306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c81a4978-6d45-4bc4-a0d8-f741d1136a39 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:18.530868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c81a4978-6d45-4bc4-a0d8-f741d1136a39 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:18.531874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c81a4978-6d45-4bc4-a0d8-f741d1136a39 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:18.532428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c81a4978-6d45-4bc4-a0d8-f741d1136a39 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:18.596223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c81a4978-6d45-4bc4-a0d8-f741d1136a39 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:18.604433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c81a4978-6d45-4bc4-a0d8-f741d1136a39 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090096 Feb 21 01:09:18.605037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1107/2028] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:18 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:18.992422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cdcd5c3d-caa2-4e8d-912c-fa9a3703f45d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:18.993107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cdcd5c3d-caa2-4e8d-912c-fa9a3703f45d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:18.999882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdcd5c3d-caa2-4e8d-912c-fa9a3703f45d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.000323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdcd5c3d-caa2-4e8d-912c-fa9a3703f45d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.001115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdcd5c3d-caa2-4e8d-912c-fa9a3703f45d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.001538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdcd5c3d-caa2-4e8d-912c-fa9a3703f45d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.286192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:19.286757 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:19.293513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.293947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.294766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.295187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.362428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:19.373027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:19.374503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:19.375627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0e35095a-349e-4fa4-a1e9-6fcc4c88103d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093444 Feb 21 01:09:19.376431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1108/2029] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:19 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:19.388221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cdcd5c3d-caa2-4e8d-912c-fa9a3703f45d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:19.398913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cdcd5c3d-caa2-4e8d-912c-fa9a3703f45d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.410367 Feb 21 01:09:19.399480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 922/2030] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:18 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:19.625246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-34aacfae-40f6-462c-9bda-3604c8db22f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:19.626309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-34aacfae-40f6-462c-9bda-3604c8db22f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:19.634182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34aacfae-40f6-462c-9bda-3604c8db22f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.634639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34aacfae-40f6-462c-9bda-3604c8db22f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.635413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34aacfae-40f6-462c-9bda-3604c8db22f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:19.635852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34aacfae-40f6-462c-9bda-3604c8db22f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:19.707545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-34aacfae-40f6-462c-9bda-3604c8db22f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:19.716000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-34aacfae-40f6-462c-9bda-3604c8db22f5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.097022 Feb 21 01:09:19.716592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1109/2031] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:19 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:20.397762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:20.398767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:20.409575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:20.410437 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:20.411205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:20.411626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:20.415782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8966ac77-a612-4426-acda-681326662d2d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:20.416404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8966ac77-a612-4426-acda-681326662d2d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:20.422752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8966ac77-a612-4426-acda-681326662d2d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:20.423207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8966ac77-a612-4426-acda-681326662d2d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:20.423985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8966ac77-a612-4426-acda-681326662d2d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:20.424444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8966ac77-a612-4426-acda-681326662d2d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:20.473511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:20.482427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:20.483919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:20.485102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7850a8c4-5e12-4f96-aa1d-59c336c97827 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.094033 Feb 21 01:09:20.485669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 923/2032] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:20 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:20.555394 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8966ac77-a612-4426-acda-681326662d2d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:20.563640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8966ac77-a612-4426-acda-681326662d2d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.151561 Feb 21 01:09:20.564225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1110/2033] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:20 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:20.742669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4ba56ed3-19bf-45ef-a1a9-bd821f78f0a3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:20.743716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4ba56ed3-19bf-45ef-a1a9-bd821f78f0a3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:20.753772 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ba56ed3-19bf-45ef-a1a9-bd821f78f0a3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:20.754503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ba56ed3-19bf-45ef-a1a9-bd821f78f0a3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:20.755785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ba56ed3-19bf-45ef-a1a9-bd821f78f0a3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:20.756531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4ba56ed3-19bf-45ef-a1a9-bd821f78f0a3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:20.823041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4ba56ed3-19bf-45ef-a1a9-bd821f78f0a3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:20.834401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4ba56ed3-19bf-45ef-a1a9-bd821f78f0a3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.098246 Feb 21 01:09:20.834976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 924/2034] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:20 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:21.504178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:21.504853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:21.514548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.515226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.516073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.516572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.580848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9da3e2c7-38c7-4894-b172-56e60bea8cf3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:21.581413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9da3e2c7-38c7-4894-b172-56e60bea8cf3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:21.588054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9da3e2c7-38c7-4894-b172-56e60bea8cf3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.588538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9da3e2c7-38c7-4894-b172-56e60bea8cf3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.589786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9da3e2c7-38c7-4894-b172-56e60bea8cf3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.589786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9da3e2c7-38c7-4894-b172-56e60bea8cf3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.591855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:21.600632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:21.602030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:21.603183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-00178a3b-a309-453b-99bf-52f20b5288a3 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103008 Feb 21 01:09:21.603742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1111/2035] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:21 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:21.727327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9da3e2c7-38c7-4894-b172-56e60bea8cf3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:21.735581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9da3e2c7-38c7-4894-b172-56e60bea8cf3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158458 Feb 21 01:09:21.736149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 925/2036] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:21 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:21.859390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d10c2a84-b745-4fc9-bad5-90d570f7116e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:21.860497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d10c2a84-b745-4fc9-bad5-90d570f7116e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:21.870663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d10c2a84-b745-4fc9-bad5-90d570f7116e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.871378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d10c2a84-b745-4fc9-bad5-90d570f7116e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.872726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d10c2a84-b745-4fc9-bad5-90d570f7116e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:21.873487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d10c2a84-b745-4fc9-bad5-90d570f7116e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:21.937812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d10c2a84-b745-4fc9-bad5-90d570f7116e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:21.946008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d10c2a84-b745-4fc9-bad5-90d570f7116e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092784 Feb 21 01:09:21.946586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1112/2037] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:21 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:22.625577 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:22.626490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:22.634366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:22.634816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:22.635592 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:22.636026 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:22.697098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:22.705668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:22.707247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:22.708419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0d2d6d25-d6d8-4321-be33-9dfce15f9d23 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.089406 Feb 21 01:09:22.709010 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 926/2038] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:22 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:22.751703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-57556364-6c78-4b0c-a937-69148c06721f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:22.752342 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-57556364-6c78-4b0c-a937-69148c06721f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:22.759015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57556364-6c78-4b0c-a937-69148c06721f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:22.759457 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57556364-6c78-4b0c-a937-69148c06721f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:22.760221 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57556364-6c78-4b0c-a937-69148c06721f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:22.760704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57556364-6c78-4b0c-a937-69148c06721f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:22.901818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-57556364-6c78-4b0c-a937-69148c06721f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:22.920768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-57556364-6c78-4b0c-a937-69148c06721f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172591 Feb 21 01:09:22.921480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1113/2039] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:22 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:22.966312 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3ef21cbe-2d12-4ac2-8a81-f4227a7b7a71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:22.967290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3ef21cbe-2d12-4ac2-8a81-f4227a7b7a71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:22.976932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ef21cbe-2d12-4ac2-8a81-f4227a7b7a71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:22.977674 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ef21cbe-2d12-4ac2-8a81-f4227a7b7a71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:22.978942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ef21cbe-2d12-4ac2-8a81-f4227a7b7a71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:22.979671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ef21cbe-2d12-4ac2-8a81-f4227a7b7a71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.043140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3ef21cbe-2d12-4ac2-8a81-f4227a7b7a71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:23.051211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3ef21cbe-2d12-4ac2-8a81-f4227a7b7a71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090892 Feb 21 01:09:23.051916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 927/2040] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:22 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:23.730162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:23.731109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:23.740233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.740707 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.741470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.741890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.808787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:23.817452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:23.818929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:23.820054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-59a8a6e4-b120-4648-a537-91701dbb28db tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.095999 Feb 21 01:09:23.820638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1114/2041] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:23 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:23.942486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e7ffbaf2-1354-4659-ac2e-840598f65d12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:23.943536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e7ffbaf2-1354-4659-ac2e-840598f65d12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:23.954124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7ffbaf2-1354-4659-ac2e-840598f65d12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.954856 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7ffbaf2-1354-4659-ac2e-840598f65d12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:23.956134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7ffbaf2-1354-4659-ac2e-840598f65d12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:23.956893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7ffbaf2-1354-4659-ac2e-840598f65d12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.068683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e94878ec-0d99-4b51-ac5a-8cfcb5bd6535 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:24.069210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e94878ec-0d99-4b51-ac5a-8cfcb5bd6535 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:24.075515 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e94878ec-0d99-4b51-ac5a-8cfcb5bd6535 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.076047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e94878ec-0d99-4b51-ac5a-8cfcb5bd6535 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.076905 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e94878ec-0d99-4b51-ac5a-8cfcb5bd6535 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.077335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e94878ec-0d99-4b51-ac5a-8cfcb5bd6535 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.107475 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e7ffbaf2-1354-4659-ac2e-840598f65d12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:24.115976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e7ffbaf2-1354-4659-ac2e-840598f65d12 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.179815 Feb 21 01:09:24.116599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 928/2042] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:23 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:24.140338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e94878ec-0d99-4b51-ac5a-8cfcb5bd6535 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:24.148718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e94878ec-0d99-4b51-ac5a-8cfcb5bd6535 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084054 Feb 21 01:09:24.149287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1115/2043] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:24 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:24.842258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:24.843148 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:24.851424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.851870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.852959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:24.853121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:24.912261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:24.920673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:24.922154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:24.923289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-092c0910-cd7e-4583-9309-61eb29814b76 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.087721 Feb 21 01:09:24.923842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 929/2044] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:24 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:25.136753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-88f4f61c-04f0-486a-959d-c4feb552cfad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:25.137601 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-88f4f61c-04f0-486a-959d-c4feb552cfad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:25.146967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-88f4f61c-04f0-486a-959d-c4feb552cfad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.147408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-88f4f61c-04f0-486a-959d-c4feb552cfad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.148183 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-88f4f61c-04f0-486a-959d-c4feb552cfad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.148648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-88f4f61c-04f0-486a-959d-c4feb552cfad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.165730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-02c141db-bfeb-46a1-9980-83a9570baf8e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:25.166396 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-02c141db-bfeb-46a1-9980-83a9570baf8e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:25.172837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-02c141db-bfeb-46a1-9980-83a9570baf8e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.173278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-02c141db-bfeb-46a1-9980-83a9570baf8e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.174039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-02c141db-bfeb-46a1-9980-83a9570baf8e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.174483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-02c141db-bfeb-46a1-9980-83a9570baf8e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.232827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-02c141db-bfeb-46a1-9980-83a9570baf8e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:25.240777 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-02c141db-bfeb-46a1-9980-83a9570baf8e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.078927 Feb 21 01:09:25.241315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 930/2045] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:25 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:25.279851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-88f4f61c-04f0-486a-959d-c4feb552cfad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:25.288565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-88f4f61c-04f0-486a-959d-c4feb552cfad tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158098 Feb 21 01:09:25.289151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1116/2046] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:25 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:25.944975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:25.945861 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:25.956271 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.957070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:25.958149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:25.958574 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:26.019567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:26.028722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:26.030205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:26.031409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-62048484-2fd1-43ac-8d6c-1ffed48f04d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.093111 Feb 21 01:09:26.031985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 931/2047] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:25 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:26.262735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-781d1c2e-f2ef-430f-8836-e4878793a407 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:26.263764 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-781d1c2e-f2ef-430f-8836-e4878793a407 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:26.274677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-781d1c2e-f2ef-430f-8836-e4878793a407 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:26.275417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-781d1c2e-f2ef-430f-8836-e4878793a407 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:26.276759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-781d1c2e-f2ef-430f-8836-e4878793a407 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:26.277480 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-781d1c2e-f2ef-430f-8836-e4878793a407 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:26.305779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-95a8d963-11a6-42ff-b3d7-a22b4f262b5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:26.306350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-95a8d963-11a6-42ff-b3d7-a22b4f262b5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:26.312963 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-95a8d963-11a6-42ff-b3d7-a22b4f262b5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:26.313411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-95a8d963-11a6-42ff-b3d7-a22b4f262b5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:26.314193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-95a8d963-11a6-42ff-b3d7-a22b4f262b5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:26.314620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-95a8d963-11a6-42ff-b3d7-a22b4f262b5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:26.341726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-781d1c2e-f2ef-430f-8836-e4878793a407 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:26.349816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-781d1c2e-f2ef-430f-8836-e4878793a407 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093696 Feb 21 01:09:26.350392 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1117/2048] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:26 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:26.455618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-95a8d963-11a6-42ff-b3d7-a22b4f262b5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:26.464418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-95a8d963-11a6-42ff-b3d7-a22b4f262b5f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162271 Feb 21 01:09:26.465004 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 932/2049] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:26 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:27.053246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:27.054200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:27.064046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.064826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.066314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.067036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.141975 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:27.150967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:27.152491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:27.153637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fdd9ba85-d919-4c64-b1a5-5257178d5369 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.106768 Feb 21 01:09:27.154243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1118/2050] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:27 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:27.368170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-859a1476-27be-4aca-a30f-9bcba15a32fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:27.368758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-859a1476-27be-4aca-a30f-9bcba15a32fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:27.375406 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-859a1476-27be-4aca-a30f-9bcba15a32fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.375851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-859a1476-27be-4aca-a30f-9bcba15a32fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.376739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-859a1476-27be-4aca-a30f-9bcba15a32fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.377172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-859a1476-27be-4aca-a30f-9bcba15a32fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.447780 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-859a1476-27be-4aca-a30f-9bcba15a32fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:27.456869 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-859a1476-27be-4aca-a30f-9bcba15a32fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092476 Feb 21 01:09:27.457522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 933/2051] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:27 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:27.484039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-79d92fc2-157b-43af-8933-fdd0f16cff6c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:27.484721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-79d92fc2-157b-43af-8933-fdd0f16cff6c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:27.492682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-79d92fc2-157b-43af-8933-fdd0f16cff6c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.493127 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-79d92fc2-157b-43af-8933-fdd0f16cff6c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.493899 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-79d92fc2-157b-43af-8933-fdd0f16cff6c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:27.494324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-79d92fc2-157b-43af-8933-fdd0f16cff6c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:27.627316 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-79d92fc2-157b-43af-8933-fdd0f16cff6c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:27.635467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-79d92fc2-157b-43af-8933-fdd0f16cff6c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157457 Feb 21 01:09:27.636079 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1119/2052] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:27 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:28.175298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:28.176511 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:28.184544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.185111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.186078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.186614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.255499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:28.263866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:28.265382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:28.266515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6e82ef42-dbf3-4d60-824f-ec4a8ee48741 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.097700 Feb 21 01:09:28.267070 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 934/2053] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:28 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:28.473126 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d1e887af-7a6c-4137-8366-acaefb1433d8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:28.473753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d1e887af-7a6c-4137-8366-acaefb1433d8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:28.480206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1e887af-7a6c-4137-8366-acaefb1433d8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.480687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1e887af-7a6c-4137-8366-acaefb1433d8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.481460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1e887af-7a6c-4137-8366-acaefb1433d8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.481893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d1e887af-7a6c-4137-8366-acaefb1433d8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.548080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d1e887af-7a6c-4137-8366-acaefb1433d8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:28.557354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d1e887af-7a6c-4137-8366-acaefb1433d8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088041 Feb 21 01:09:28.557914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1120/2054] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:28 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:28.656257 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-212e80db-2273-4fe4-bd56-d97faf91fb29 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:28.657313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-212e80db-2273-4fe4-bd56-d97faf91fb29 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:28.665098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-212e80db-2273-4fe4-bd56-d97faf91fb29 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.665496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-212e80db-2273-4fe4-bd56-d97faf91fb29 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.666246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-212e80db-2273-4fe4-bd56-d97faf91fb29 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:28.666671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-212e80db-2273-4fe4-bd56-d97faf91fb29 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:28.808108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-212e80db-2273-4fe4-bd56-d97faf91fb29 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:28.816508 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-212e80db-2273-4fe4-bd56-d97faf91fb29 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166419 Feb 21 01:09:28.817117 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 935/2055] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:28 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:29.288925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:29.289944 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:29.300122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.300920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:29.302190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.302908 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:29.372592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:29.382848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:29.384295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:29.385454 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a906ff4d-2124-4a5a-aa41-408eb52f04e5 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 200 len: 1444 microversion: 2.20 time: 0.103039 Feb 21 01:09:29.385986 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1121/2056] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:29 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:29.403874 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4f6ba431-519d-460e-a714-f48338fdbd8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '.version_select at 0x7fe56d2ead30>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:29.428289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4f6ba431-519d-460e-a714-f48338fdbd8f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587300889" status: 204 len: 0 microversion: 2.20 time: 0.027737 Feb 21 01:09:29.429420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 936/2057] 10.222.0.72 () {60 vars in 1261 bytes} [Mon Feb 21 01:09:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587300889 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 21 01:09:29.574066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-afd59686-07e9-4518-a935-34be7bab3713 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:29.574792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-afd59686-07e9-4518-a935-34be7bab3713 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:29.581509 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-afd59686-07e9-4518-a935-34be7bab3713 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.581949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-afd59686-07e9-4518-a935-34be7bab3713 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:29.582765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-afd59686-07e9-4518-a935-34be7bab3713 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.583187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-afd59686-07e9-4518-a935-34be7bab3713 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:29.656226 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-afd59686-07e9-4518-a935-34be7bab3713 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:29.664052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-afd59686-07e9-4518-a935-34be7bab3713 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093641 Feb 21 01:09:29.664662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1122/2058] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:29 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:29.833562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f177969d-8dff-400e-a796-66f197a65d48 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:29.834139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f177969d-8dff-400e-a796-66f197a65d48 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:29.840651 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f177969d-8dff-400e-a796-66f197a65d48 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.841111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f177969d-8dff-400e-a796-66f197a65d48 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:29.841920 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f177969d-8dff-400e-a796-66f197a65d48 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:29.842350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f177969d-8dff-400e-a796-66f197a65d48 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:30.037140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f177969d-8dff-400e-a796-66f197a65d48 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:30.045378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f177969d-8dff-400e-a796-66f197a65d48 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.215570 Feb 21 01:09:30.045985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 937/2059] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:29 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:30.260460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fb40ae16-d776-4bfb-a957-99e6e8907e5e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Action: 'create', calling method: .version_select at 0x7fe56c97b670>, body: {"keypair": {"name": "tempest-keypair-860944921"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:30.275741 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-fb40ae16-d776-4bfb-a957-99e6e8907e5e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for project c06103339bc54d0f93b531034454d6ab. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:09:30.280110 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-fb40ae16-d776-4bfb-a957-99e6e8907e5e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for user 1d9176fb26604a1190825afedf8823cb and project c06103339bc54d0f93b531034454d6ab. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:09:30.675439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-fb40ae16-d776-4bfb-a957-99e6e8907e5e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for project c06103339bc54d0f93b531034454d6ab. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:09:30.679301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-fb40ae16-d776-4bfb-a957-99e6e8907e5e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for user 1d9176fb26604a1190825afedf8823cb and project c06103339bc54d0f93b531034454d6ab. Resources: {'key_pairs'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:09:30.680997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ce41e541-5dba-49c1-98bc-a2a7f11f3fc4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:30.681672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ce41e541-5dba-49c1-98bc-a2a7f11f3fc4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:30.688184 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce41e541-5dba-49c1-98bc-a2a7f11f3fc4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:30.688727 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce41e541-5dba-49c1-98bc-a2a7f11f3fc4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:30.689488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce41e541-5dba-49c1-98bc-a2a7f11f3fc4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:30.689913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ce41e541-5dba-49c1-98bc-a2a7f11f3fc4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:30.692703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fb40ae16-d776-4bfb-a957-99e6e8907e5e tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.436015 Feb 21 01:09:30.693337 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1123/2060] 10.222.0.72 () {62 vars in 1198 bytes} [Mon Feb 21 01:09:30 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 437 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:09:30.751202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ce41e541-5dba-49c1-98bc-a2a7f11f3fc4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:30.759291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ce41e541-5dba-49c1-98bc-a2a7f11f3fc4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082170 Feb 21 01:09:30.759842 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 938/2061] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:30 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:31.062712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2f52e2ab-0a93-4f27-805a-3ddd9bf64171 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:31.063522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2f52e2ab-0a93-4f27-805a-3ddd9bf64171 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:31.069682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f52e2ab-0a93-4f27-805a-3ddd9bf64171 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.070069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f52e2ab-0a93-4f27-805a-3ddd9bf64171 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:31.070846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f52e2ab-0a93-4f27-805a-3ddd9bf64171 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.071277 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2f52e2ab-0a93-4f27-805a-3ddd9bf64171 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:31.208695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2f52e2ab-0a93-4f27-805a-3ddd9bf64171 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:31.216941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2f52e2ab-0a93-4f27-805a-3ddd9bf64171 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158078 Feb 21 01:09:31.217522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1124/2062] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:31 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:31.776943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ab1ddd7f-ad53-486b-b5b3-71ef5a0c1de8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:31.777572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ab1ddd7f-ad53-486b-b5b3-71ef5a0c1de8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:31.787314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd7f-ad53-486b-b5b3-71ef5a0c1de8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.787935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd7f-ad53-486b-b5b3-71ef5a0c1de8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:31.788826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd7f-ad53-486b-b5b3-71ef5a0c1de8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:31.789443 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd7f-ad53-486b-b5b3-71ef5a0c1de8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:31.868328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ab1ddd7f-ad53-486b-b5b3-71ef5a0c1de8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:31.876151 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ab1ddd7f-ad53-486b-b5b3-71ef5a0c1de8 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.103249 Feb 21 01:09:31.876746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 939/2063] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:31 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:32.085682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-920644227", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a392dac-feaa-4ee9-a8a2-bdfc4029b2f0"}], "security_groups": [{"name": "tempest-securitygroup--606576842"}], "key_name": "tempest-keypair-860944921", "user_data": "}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:32.234655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-de9a4e13-b9cf-4354-8fcc-b79a8c00c063 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:32.236286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-de9a4e13-b9cf-4354-8fcc-b79a8c00c063 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:32.243344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-de9a4e13-b9cf-4354-8fcc-b79a8c00c063 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:32.243783 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-de9a4e13-b9cf-4354-8fcc-b79a8c00c063 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.244606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-de9a4e13-b9cf-4354-8fcc-b79a8c00c063 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:32.245032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-de9a4e13-b9cf-4354-8fcc-b79a8c00c063 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.390280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-de9a4e13-b9cf-4354-8fcc-b79a8c00c063 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:32.398988 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-de9a4e13-b9cf-4354-8fcc-b79a8c00c063 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168190 Feb 21 01:09:32.399608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 940/2064] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:32 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:32.435388 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] validate_networks() for [('6a392dac-feaa-4ee9-a8a2-bdfc4029b2f0', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:09:32.875570 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:09:32.876103 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:09:32.876842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:09:32.877420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:09:32.878046 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:09:32.888035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:32.888510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.889330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:32.889766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.892818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d36b8e9b-e6a4-4c33-9633-94e8853cafcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:32.893430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d36b8e9b-e6a4-4c33-9633-94e8853cafcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:32.900689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d36b8e9b-e6a4-4c33-9633-94e8853cafcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:32.901064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d36b8e9b-e6a4-4c33-9633-94e8853cafcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.901840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d36b8e9b-e6a4-4c33-9633-94e8853cafcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:32.902260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d36b8e9b-e6a4-4c33-9633-94e8853cafcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:32.906983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for project c06103339bc54d0f93b531034454d6ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:09:32.911314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Getting quotas for user 1d9176fb26604a1190825afedf8823cb and project c06103339bc54d0f93b531034454d6ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:09:32.922484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:09:32.924882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:09:32.963782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d36b8e9b-e6a4-4c33-9633-94e8853cafcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:32.971930 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d36b8e9b-e6a4-4c33-9633-94e8853cafcf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082781 Feb 21 01:09:32.972512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 941/2065] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:32 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:32.976058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cf6bb3d1-554f-4d03-9ba4-218b7809f76d tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.895909 Feb 21 01:09:32.981622 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1125/2066] 10.222.0.72 () {62 vars in 1187 bytes} [Mon Feb 21 01:09:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 21 01:09:32.986535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e42f8c7e-733b-4169-8fe8-fe9af8b3f3b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:32.987109 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e42f8c7e-733b-4169-8fe8-fe9af8b3f3b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:33.038943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e42f8c7e-733b-4169-8fe8-fe9af8b3f3b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:33.046054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e42f8c7e-733b-4169-8fe8-fe9af8b3f3b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:33.047535 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e42f8c7e-733b-4169-8fe8-fe9af8b3f3b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:33.048858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e42f8c7e-733b-4169-8fe8-fe9af8b3f3b6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1280 microversion: 2.20 time: 0.066035 Feb 21 01:09:33.049416 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 942/2067] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:32 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1280 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:33.415292 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b56c230d-bb5d-4618-98d7-2dab6bef7407 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:33.415948 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b56c230d-bb5d-4618-98d7-2dab6bef7407 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:33.422744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b56c230d-bb5d-4618-98d7-2dab6bef7407 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.423208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b56c230d-bb5d-4618-98d7-2dab6bef7407 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:33.424056 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b56c230d-bb5d-4618-98d7-2dab6bef7407 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.424508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b56c230d-bb5d-4618-98d7-2dab6bef7407 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:33.565808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b56c230d-bb5d-4618-98d7-2dab6bef7407 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:33.573867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b56c230d-bb5d-4618-98d7-2dab6bef7407 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162498 Feb 21 01:09:33.574453 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1126/2068] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:33 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:33.989337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0365ff25-26a7-4821-80bd-407b2db242f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:33.990075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0365ff25-26a7-4821-80bd-407b2db242f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:33.998061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0365ff25-26a7-4821-80bd-407b2db242f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:33.998501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0365ff25-26a7-4821-80bd-407b2db242f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:33.999804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0365ff25-26a7-4821-80bd-407b2db242f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.000250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0365ff25-26a7-4821-80bd-407b2db242f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.067152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:34.067763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:34.074125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.074611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.075595 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.076255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.098533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0365ff25-26a7-4821-80bd-407b2db242f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:34.107799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0365ff25-26a7-4821-80bd-407b2db242f6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.122533 Feb 21 01:09:34.108792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 943/2069] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:33 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:34.139302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:34.147827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:34.149333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:34.150443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b7dc7b8e-6ba0-4f72-a5c7-fc84e3d8b812 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1350 microversion: 2.20 time: 0.087235 Feb 21 01:09:34.150997 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1127/2070] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:34 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:09:34.591584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-68093144-06fb-490b-9b65-e1fd54ab4509 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:34.592187 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-68093144-06fb-490b-9b65-e1fd54ab4509 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:34.598188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68093144-06fb-490b-9b65-e1fd54ab4509 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.598712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68093144-06fb-490b-9b65-e1fd54ab4509 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.599501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68093144-06fb-490b-9b65-e1fd54ab4509 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:34.599918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68093144-06fb-490b-9b65-e1fd54ab4509 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:34.836892 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-68093144-06fb-490b-9b65-e1fd54ab4509 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:34.846015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-68093144-06fb-490b-9b65-e1fd54ab4509 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.258435 Feb 21 01:09:34.846543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 944/2071] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:34 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:35.125151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b86c367e-bf65-44fd-b444-394565cab30c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:35.125737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b86c367e-bf65-44fd-b444-394565cab30c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:35.132590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b86c367e-bf65-44fd-b444-394565cab30c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.133039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b86c367e-bf65-44fd-b444-394565cab30c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.133828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b86c367e-bf65-44fd-b444-394565cab30c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.134259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b86c367e-bf65-44fd-b444-394565cab30c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.168258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:35.169544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:35.175828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.176294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.177318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.177743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.195627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b86c367e-bf65-44fd-b444-394565cab30c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:35.203602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b86c367e-bf65-44fd-b444-394565cab30c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082387 Feb 21 01:09:35.204374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1128/2072] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:35 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:35.427824 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:35.437918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:35.439864 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:35.441061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-11da7dca-edba-4f79-8d20-7cbdf59ca653 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.276594 Feb 21 01:09:35.441622 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 945/2073] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:35 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:09:35.594925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-fee82cc7-f0cd-4cd1-9bb2-7f243cae298a req-44198eff-f7b9-4b30-9c41-bcb6f115eaad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7778906-67a3-420a-b203-13e1eb3812fb", "tag": "8700ee42-a07a-4134-b47a-50fd73f95601"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:35.596808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:35.596808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:09:35.605577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-fee82cc7-f0cd-4cd1-9bb2-7f243cae298a req-44198eff-f7b9-4b30-9c41-bcb6f115eaad service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.606055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-fee82cc7-f0cd-4cd1-9bb2-7f243cae298a req-44198eff-f7b9-4b30-9c41-bcb6f115eaad service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.627206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-fee82cc7-f0cd-4cd1-9bb2-7f243cae298a req-44198eff-f7b9-4b30-9c41-bcb6f115eaad service nova] Creating event network-changed:8700ee42-a07a-4134-b47a-50fd73f95601 for instance b7778906-67a3-420a-b203-13e1eb3812fb on hv-cinder-81322 Feb 21 01:09:35.636641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-fee82cc7-f0cd-4cd1-9bb2-7f243cae298a req-44198eff-f7b9-4b30-9c41-bcb6f115eaad service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045693 Feb 21 01:09:35.638194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1129/2074] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:35.863157 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f32588be-e810-4f22-8ead-96fbce6f5c0d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:35.863770 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f32588be-e810-4f22-8ead-96fbce6f5c0d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:35.870136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f32588be-e810-4f22-8ead-96fbce6f5c0d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.870617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f32588be-e810-4f22-8ead-96fbce6f5c0d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:35.871385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f32588be-e810-4f22-8ead-96fbce6f5c0d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:35.871792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f32588be-e810-4f22-8ead-96fbce6f5c0d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:36.082397 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f32588be-e810-4f22-8ead-96fbce6f5c0d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:36.091085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f32588be-e810-4f22-8ead-96fbce6f5c0d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.231618 Feb 21 01:09:36.091687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 946/2075] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:35 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:36.221615 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-57e81250-4952-4714-90a5-da26dd93ee73 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:36.222317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-57e81250-4952-4714-90a5-da26dd93ee73 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:36.228440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57e81250-4952-4714-90a5-da26dd93ee73 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:36.228891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57e81250-4952-4714-90a5-da26dd93ee73 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:36.229738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57e81250-4952-4714-90a5-da26dd93ee73 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:36.230157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-57e81250-4952-4714-90a5-da26dd93ee73 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:36.294596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-57e81250-4952-4714-90a5-da26dd93ee73 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:36.303254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-57e81250-4952-4714-90a5-da26dd93ee73 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086235 Feb 21 01:09:36.303796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1130/2076] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:36 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:36.459508 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:36.460135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:36.466706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:36.467153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:36.467939 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:36.468369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:36.655716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:36.664093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:36.665661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:36.666766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8ac8508e-0b45-48a5-be20-ba96bc4ec691 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.211323 Feb 21 01:09:36.667305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 947/2077] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:36 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:37.109345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3794a3b3-1983-4602-93b1-8dc1d4fbe641 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:37.109964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3794a3b3-1983-4602-93b1-8dc1d4fbe641 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:37.116624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3794a3b3-1983-4602-93b1-8dc1d4fbe641 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.117077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3794a3b3-1983-4602-93b1-8dc1d4fbe641 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.117854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3794a3b3-1983-4602-93b1-8dc1d4fbe641 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.118287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3794a3b3-1983-4602-93b1-8dc1d4fbe641 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.262586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3794a3b3-1983-4602-93b1-8dc1d4fbe641 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:37.272291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3794a3b3-1983-4602-93b1-8dc1d4fbe641 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166519 Feb 21 01:09:37.273229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1131/2078] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:37 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:37.321045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9b478632-3138-43eb-90fd-62d1ed2056e6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:37.321646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9b478632-3138-43eb-90fd-62d1ed2056e6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:37.328142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9b478632-3138-43eb-90fd-62d1ed2056e6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.328619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9b478632-3138-43eb-90fd-62d1ed2056e6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.329388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9b478632-3138-43eb-90fd-62d1ed2056e6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.329813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9b478632-3138-43eb-90fd-62d1ed2056e6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.395143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9b478632-3138-43eb-90fd-62d1ed2056e6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:37.404526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9b478632-3138-43eb-90fd-62d1ed2056e6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.087145 Feb 21 01:09:37.405328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 948/2079] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:37 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:37.688369 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:37.689330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:37.699451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.700188 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.701507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:37.702214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:37.853443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:37.861535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:37.863025 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:37.864211 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d63aba6c-6e85-4bf1-a61a-907ebab08925 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.182175 Feb 21 01:09:37.864814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1132/2080] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:37 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:38.290740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7bd31aab-7d77-4739-883e-51d67c313f4f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:38.291346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7bd31aab-7d77-4739-883e-51d67c313f4f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:38.298153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7bd31aab-7d77-4739-883e-51d67c313f4f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.298611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7bd31aab-7d77-4739-883e-51d67c313f4f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.299401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7bd31aab-7d77-4739-883e-51d67c313f4f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.299857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7bd31aab-7d77-4739-883e-51d67c313f4f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.421967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9962596f-ab4c-4b93-a204-8c55b6d21176 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:38.422734 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9962596f-ab4c-4b93-a204-8c55b6d21176 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:38.429744 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9962596f-ab4c-4b93-a204-8c55b6d21176 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.430259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9962596f-ab4c-4b93-a204-8c55b6d21176 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.431093 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9962596f-ab4c-4b93-a204-8c55b6d21176 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.431596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9962596f-ab4c-4b93-a204-8c55b6d21176 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.435709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7bd31aab-7d77-4739-883e-51d67c313f4f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:38.443970 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7bd31aab-7d77-4739-883e-51d67c313f4f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.156884 Feb 21 01:09:38.444539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 949/2081] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:38 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:38.497049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9962596f-ab4c-4b93-a204-8c55b6d21176 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:38.509049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9962596f-ab4c-4b93-a204-8c55b6d21176 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090458 Feb 21 01:09:38.509921 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1133/2082] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:38 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:38.891176 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:38.892169 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:38.902995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.903729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:38.905063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:38.905781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.050900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:39.058904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:39.060422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:39.061551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5dc74224-25e9-4a46-8c51-1931582830cb tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.176765 Feb 21 01:09:39.062130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 950/2083] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:38 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:39.465297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3d079a02-77df-4863-8f2b-01c6c1da30f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:39.466355 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3d079a02-77df-4863-8f2b-01c6c1da30f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:39.477148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3d079a02-77df-4863-8f2b-01c6c1da30f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.477894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3d079a02-77df-4863-8f2b-01c6c1da30f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.479123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3d079a02-77df-4863-8f2b-01c6c1da30f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.479887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3d079a02-77df-4863-8f2b-01c6c1da30f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.529938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1844b872-6c9f-4f51-bb71-325f606e5326 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:39.530626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1844b872-6c9f-4f51-bb71-325f606e5326 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:39.538024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1844b872-6c9f-4f51-bb71-325f606e5326 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.538464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1844b872-6c9f-4f51-bb71-325f606e5326 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.539245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1844b872-6c9f-4f51-bb71-325f606e5326 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:39.539671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1844b872-6c9f-4f51-bb71-325f606e5326 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:39.598758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1844b872-6c9f-4f51-bb71-325f606e5326 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:39.606611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1844b872-6c9f-4f51-bb71-325f606e5326 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.080461 Feb 21 01:09:39.607294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 951/2084] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:39 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:39.616409 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3d079a02-77df-4863-8f2b-01c6c1da30f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:39.624351 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3d079a02-77df-4863-8f2b-01c6c1da30f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165361 Feb 21 01:09:39.624941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1134/2085] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:39 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:40.082933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:40.083640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:40.091025 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.091541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.092446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.092971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.232345 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:40.240202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:40.241716 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:40.242811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-700287de-20fd-408a-be26-99f026580b6f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.166234 Feb 21 01:09:40.243367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 952/2086] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:40 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:40.627662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-95408bc7-43b9-427b-ab9a-3c12f8b925ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:40.628752 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-95408bc7-43b9-427b-ab9a-3c12f8b925ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:40.636034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-95408bc7-43b9-427b-ab9a-3c12f8b925ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.636507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-95408bc7-43b9-427b-ab9a-3c12f8b925ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.637281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-95408bc7-43b9-427b-ab9a-3c12f8b925ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.637699 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-95408bc7-43b9-427b-ab9a-3c12f8b925ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.641322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8d102e6f-10ff-4e5a-b55c-ca56ef418134 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:40.642379 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8d102e6f-10ff-4e5a-b55c-ca56ef418134 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:40.652942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d102e6f-10ff-4e5a-b55c-ca56ef418134 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.653629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d102e6f-10ff-4e5a-b55c-ca56ef418134 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.654822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d102e6f-10ff-4e5a-b55c-ca56ef418134 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:40.655479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8d102e6f-10ff-4e5a-b55c-ca56ef418134 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:40.704598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-95408bc7-43b9-427b-ab9a-3c12f8b925ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:40.712848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-95408bc7-43b9-427b-ab9a-3c12f8b925ea tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091420 Feb 21 01:09:40.713625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1135/2087] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:40 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:40.789313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8d102e6f-10ff-4e5a-b55c-ca56ef418134 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:40.797893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8d102e6f-10ff-4e5a-b55c-ca56ef418134 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160508 Feb 21 01:09:40.798461 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 953/2088] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:40 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:41.264381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:41.265499 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:41.276089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.276925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.278164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.278877 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.418843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:41.426895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:41.428379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:41.429530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bec9f566-fccb-4e78-93ce-21f5b587a117 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.171339 Feb 21 01:09:41.430124 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1136/2089] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:41 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:41.733522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f4cec749-8691-45fc-84d4-1a7ddd33209a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:41.734533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f4cec749-8691-45fc-84d4-1a7ddd33209a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:41.742773 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4cec749-8691-45fc-84d4-1a7ddd33209a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.743212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4cec749-8691-45fc-84d4-1a7ddd33209a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.743985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4cec749-8691-45fc-84d4-1a7ddd33209a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.744431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4cec749-8691-45fc-84d4-1a7ddd33209a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.812090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f4cec749-8691-45fc-84d4-1a7ddd33209a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:41.815138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2d57b1ff-1633-4323-bb21-d3a97998855c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:41.815737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2d57b1ff-1633-4323-bb21-d3a97998855c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:41.821107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f4cec749-8691-45fc-84d4-1a7ddd33209a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093857 Feb 21 01:09:41.821679 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 954/2090] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:41 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:41.822051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d57b1ff-1633-4323-bb21-d3a97998855c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.822486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d57b1ff-1633-4323-bb21-d3a97998855c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.823250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d57b1ff-1633-4323-bb21-d3a97998855c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:41.823867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d57b1ff-1633-4323-bb21-d3a97998855c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:41.959233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2d57b1ff-1633-4323-bb21-d3a97998855c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:41.967310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2d57b1ff-1633-4323-bb21-d3a97998855c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.155733 Feb 21 01:09:41.967879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1137/2091] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:41 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:42.450324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:42.451313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:42.460107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.460598 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.461365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.461794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.604690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:42.617479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:42.619695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:42.621418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7fa1cdd0-c494-4a18-a125-c73ed6d6a7bf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.177109 Feb 21 01:09:42.622292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 955/2092] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:42 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:42.842012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-42cd84db-6eef-4e03-a65d-33bb189e301e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:42.842974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-42cd84db-6eef-4e03-a65d-33bb189e301e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:42.851562 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42cd84db-6eef-4e03-a65d-33bb189e301e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.852004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42cd84db-6eef-4e03-a65d-33bb189e301e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.852799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42cd84db-6eef-4e03-a65d-33bb189e301e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.853229 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42cd84db-6eef-4e03-a65d-33bb189e301e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.922104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-42cd84db-6eef-4e03-a65d-33bb189e301e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:42.930349 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-42cd84db-6eef-4e03-a65d-33bb189e301e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.094480 Feb 21 01:09:42.930920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1138/2093] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:42 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:42.984943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2ce4f3db-3d49-46b5-9623-2b51b6eb3310 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:42.985559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2ce4f3db-3d49-46b5-9623-2b51b6eb3310 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:42.994610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ce4f3db-3d49-46b5-9623-2b51b6eb3310 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.995065 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ce4f3db-3d49-46b5-9623-2b51b6eb3310 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:42.995852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ce4f3db-3d49-46b5-9623-2b51b6eb3310 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:42.996281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2ce4f3db-3d49-46b5-9623-2b51b6eb3310 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.146268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2ce4f3db-3d49-46b5-9623-2b51b6eb3310 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:43.154093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2ce4f3db-3d49-46b5-9623-2b51b6eb3310 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172839 Feb 21 01:09:43.154661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 956/2094] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:42 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:43.633897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-7e5dcc6f-3efa-4488-b0f9-a6cdfe907a43 req-e6d12dc2-dc2c-4d2c-b5ff-29ddce5e4d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7778906-67a3-420a-b203-13e1eb3812fb", "name": "network-vif-plugged", "status": "completed", "tag": "8700ee42-a07a-4134-b47a-50fd73f95601"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:43.635672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:43.635672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:09:43.641585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:43.642258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:43.643583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-7e5dcc6f-3efa-4488-b0f9-a6cdfe907a43 req-e6d12dc2-dc2c-4d2c-b5ff-29ddce5e4d49 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.644035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-7e5dcc6f-3efa-4488-b0f9-a6cdfe907a43 req-e6d12dc2-dc2c-4d2c-b5ff-29ddce5e4d49 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.649683 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.650120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.650899 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.651326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.655464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-7e5dcc6f-3efa-4488-b0f9-a6cdfe907a43 req-e6d12dc2-dc2c-4d2c-b5ff-29ddce5e4d49 service nova] Creating event network-vif-plugged:8700ee42-a07a-4134-b47a-50fd73f95601 for instance b7778906-67a3-420a-b203-13e1eb3812fb on hv-cinder-81322 Feb 21 01:09:43.661073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-7e5dcc6f-3efa-4488-b0f9-a6cdfe907a43 req-e6d12dc2-dc2c-4d2c-b5ff-29ddce5e4d49 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090269 Feb 21 01:09:43.661658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1139/2095] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:43.786965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:43.794720 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:43.796259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:43.797360 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5adb967d-2c3d-4344-9bb7-cdf90333e28f tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.159542 Feb 21 01:09:43.797959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 957/2096] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:43 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:09:43.951674 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7f5d2fc7-47a7-4d6a-a948-abee17712487 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:43.952942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7f5d2fc7-47a7-4d6a-a948-abee17712487 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:43.961539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f5d2fc7-47a7-4d6a-a948-abee17712487 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.961983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f5d2fc7-47a7-4d6a-a948-abee17712487 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:43.962762 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f5d2fc7-47a7-4d6a-a948-abee17712487 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:43.963190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7f5d2fc7-47a7-4d6a-a948-abee17712487 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:44.030766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7f5d2fc7-47a7-4d6a-a948-abee17712487 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:44.042918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7f5d2fc7-47a7-4d6a-a948-abee17712487 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.097682 Feb 21 01:09:44.043680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1140/2097] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:43 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:44.175613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b15d026d-0657-4b3d-9670-939a0bd0ffcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:44.176690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b15d026d-0657-4b3d-9670-939a0bd0ffcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:44.187171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b15d026d-0657-4b3d-9670-939a0bd0ffcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:44.187920 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b15d026d-0657-4b3d-9670-939a0bd0ffcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:44.189263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b15d026d-0657-4b3d-9670-939a0bd0ffcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:44.189983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b15d026d-0657-4b3d-9670-939a0bd0ffcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:44.356136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b15d026d-0657-4b3d-9670-939a0bd0ffcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:44.364279 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b15d026d-0657-4b3d-9670-939a0bd0ffcc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.195747 Feb 21 01:09:44.364882 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 958/2098] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:44 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:44.816832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:44.817477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:44.823989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:44.824428 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:44.825257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:44.825692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:44.972427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:44.980335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:44.981846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:44.984421 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3049ba12-1b16-422e-ad0f-a15d0c45b108 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1405 microversion: 2.20 time: 0.172410 Feb 21 01:09:44.985008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1141/2099] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:44 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:45.066538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-df6ee786-6f18-403d-ba5e-246aa4dc2d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:45.067632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-df6ee786-6f18-403d-ba5e-246aa4dc2d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:45.074192 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df6ee786-6f18-403d-ba5e-246aa4dc2d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:45.074629 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df6ee786-6f18-403d-ba5e-246aa4dc2d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:45.075395 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df6ee786-6f18-403d-ba5e-246aa4dc2d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:45.075821 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-df6ee786-6f18-403d-ba5e-246aa4dc2d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:45.144211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-df6ee786-6f18-403d-ba5e-246aa4dc2d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:45.153703 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-df6ee786-6f18-403d-ba5e-246aa4dc2d3e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093493 Feb 21 01:09:45.154276 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 959/2100] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:45 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:45.382071 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-46aea666-bbb2-4d56-9f8a-15c309ea08a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:45.382607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-46aea666-bbb2-4d56-9f8a-15c309ea08a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:45.389158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46aea666-bbb2-4d56-9f8a-15c309ea08a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:45.389713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46aea666-bbb2-4d56-9f8a-15c309ea08a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:45.390671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46aea666-bbb2-4d56-9f8a-15c309ea08a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:45.391170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-46aea666-bbb2-4d56-9f8a-15c309ea08a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:45.528517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-46aea666-bbb2-4d56-9f8a-15c309ea08a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:45.536556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-46aea666-bbb2-4d56-9f8a-15c309ea08a1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158756 Feb 21 01:09:45.537259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1142/2101] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:45 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:46.006017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:46.007071 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:46.017823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.018557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.019818 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.020922 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.154510 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:46.166436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:46.168879 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:46.170586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6bd2348a-693a-4ab0-ae40-e1e084e114bd tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1598 microversion: 2.20 time: 0.170649 Feb 21 01:09:46.171281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 960/2102] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:09:45 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:09:46.175769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4ddb4171-ff34-48e0-90bb-09aa16ec9d49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:46.176413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4ddb4171-ff34-48e0-90bb-09aa16ec9d49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:46.182863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ddb4171-ff34-48e0-90bb-09aa16ec9d49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.183304 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ddb4171-ff34-48e0-90bb-09aa16ec9d49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.184138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ddb4171-ff34-48e0-90bb-09aa16ec9d49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.184524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4ddb4171-ff34-48e0-90bb-09aa16ec9d49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.188985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-544742e2-6573-48d9-b700-d580d0f38223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:46.189475 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-544742e2-6573-48d9-b700-d580d0f38223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:46.195300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-544742e2-6573-48d9-b700-d580d0f38223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.195751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-544742e2-6573-48d9-b700-d580d0f38223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.196556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-544742e2-6573-48d9-b700-d580d0f38223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.196991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-544742e2-6573-48d9-b700-d580d0f38223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.247785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4ddb4171-ff34-48e0-90bb-09aa16ec9d49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:46.256118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4ddb4171-ff34-48e0-90bb-09aa16ec9d49 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.083938 Feb 21 01:09:46.256695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1143/2103] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:46 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:46.281256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-544742e2-6573-48d9-b700-d580d0f38223 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097157 Feb 21 01:09:46.281850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 961/2104] 10.222.0.72 () {60 vars in 1315 bytes} [Mon Feb 21 01:09:46 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:09:46.554251 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-adde21e2-78c8-4f07-bf41-1ee980e46d33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:46.555063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-adde21e2-78c8-4f07-bf41-1ee980e46d33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:46.561769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-adde21e2-78c8-4f07-bf41-1ee980e46d33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.562232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-adde21e2-78c8-4f07-bf41-1ee980e46d33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.563021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-adde21e2-78c8-4f07-bf41-1ee980e46d33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:46.563452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-adde21e2-78c8-4f07-bf41-1ee980e46d33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:46.704838 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-adde21e2-78c8-4f07-bf41-1ee980e46d33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:46.713370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-adde21e2-78c8-4f07-bf41-1ee980e46d33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162951 Feb 21 01:09:46.713969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1144/2105] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:46 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:47.274866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f6f6e5f5-dffb-48b2-90e0-ce7bb93eda75 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:47.275414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f6f6e5f5-dffb-48b2-90e0-ce7bb93eda75 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:47.283036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6f6e5f5-dffb-48b2-90e0-ce7bb93eda75 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.283737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6f6e5f5-dffb-48b2-90e0-ce7bb93eda75 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.284588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6f6e5f5-dffb-48b2-90e0-ce7bb93eda75 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.285012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6f6e5f5-dffb-48b2-90e0-ce7bb93eda75 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.356865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f6f6e5f5-dffb-48b2-90e0-ce7bb93eda75 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:47.364952 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f6f6e5f5-dffb-48b2-90e0-ce7bb93eda75 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095291 Feb 21 01:09:47.372441 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 962/2106] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:47 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:47.526439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-11d3ffa0-99c2-4e59-8b68-841f77e9bcf7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:47.527058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-11d3ffa0-99c2-4e59-8b68-841f77e9bcf7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:47.527244 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-82f81a42-8383-46c5-ab85-fff234639dc8 req-199f496e-1b08-47ec-a54e-b5d6f4db59bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7778906-67a3-420a-b203-13e1eb3812fb", "tag": "8700ee42-a07a-4134-b47a-50fd73f95601"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:09:47.528851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:47.528851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:09:47.535719 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-82f81a42-8383-46c5-ab85-fff234639dc8 req-199f496e-1b08-47ec-a54e-b5d6f4db59bc service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.536158 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-82f81a42-8383-46c5-ab85-fff234639dc8 req-199f496e-1b08-47ec-a54e-b5d6f4db59bc service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.537345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11d3ffa0-99c2-4e59-8b68-841f77e9bcf7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.537862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11d3ffa0-99c2-4e59-8b68-841f77e9bcf7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.538714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11d3ffa0-99c2-4e59-8b68-841f77e9bcf7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.539205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-11d3ffa0-99c2-4e59-8b68-841f77e9bcf7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.549354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-82f81a42-8383-46c5-ab85-fff234639dc8 req-199f496e-1b08-47ec-a54e-b5d6f4db59bc service nova] Creating event network-changed:8700ee42-a07a-4134-b47a-50fd73f95601 for instance b7778906-67a3-420a-b203-13e1eb3812fb on hv-cinder-81322 Feb 21 01:09:47.555090 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-82f81a42-8383-46c5-ab85-fff234639dc8 req-199f496e-1b08-47ec-a54e-b5d6f4db59bc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031371 Feb 21 01:09:47.556339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 963/2107] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:09:47.568147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-11d3ffa0-99c2-4e59-8b68-841f77e9bcf7 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb/ips" status: 200 len: 113 microversion: 2.20 time: 0.045691 Feb 21 01:09:47.568972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1145/2108] 10.222.0.72 () {60 vars in 1288 bytes} [Mon Feb 21 01:09:47 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb/ips => generated 113 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:09:47.730880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4f910300-8f61-4e83-a542-1bc9a4df8408 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:47.731712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4f910300-8f61-4e83-a542-1bc9a4df8408 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:47.737985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f910300-8f61-4e83-a542-1bc9a4df8408 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.738490 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f910300-8f61-4e83-a542-1bc9a4df8408 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.739268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f910300-8f61-4e83-a542-1bc9a4df8408 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:47.739704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f910300-8f61-4e83-a542-1bc9a4df8408 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:47.955533 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4f910300-8f61-4e83-a542-1bc9a4df8408 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:47.963928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4f910300-8f61-4e83-a542-1bc9a4df8408 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.237101 Feb 21 01:09:47.964884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 964/2109] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:47 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:48.382240 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-44890849-1bb5-4c0e-88a7-c25e3fda51d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:48.382925 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-44890849-1bb5-4c0e-88a7-c25e3fda51d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:48.389146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-44890849-1bb5-4c0e-88a7-c25e3fda51d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:48.389596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-44890849-1bb5-4c0e-88a7-c25e3fda51d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:48.390390 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-44890849-1bb5-4c0e-88a7-c25e3fda51d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:48.390865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-44890849-1bb5-4c0e-88a7-c25e3fda51d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:48.452152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-44890849-1bb5-4c0e-88a7-c25e3fda51d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:48.460611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-44890849-1bb5-4c0e-88a7-c25e3fda51d5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082226 Feb 21 01:09:48.461507 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1146/2110] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:48 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:48.985016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0fb477fd-31d9-4629-999b-56b29aa4411c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:48.985897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0fb477fd-31d9-4629-999b-56b29aa4411c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:48.994020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0fb477fd-31d9-4629-999b-56b29aa4411c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:48.994460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0fb477fd-31d9-4629-999b-56b29aa4411c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:48.995236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0fb477fd-31d9-4629-999b-56b29aa4411c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:48.995653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0fb477fd-31d9-4629-999b-56b29aa4411c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:49.143425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0fb477fd-31d9-4629-999b-56b29aa4411c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:49.152332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0fb477fd-31d9-4629-999b-56b29aa4411c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173556 Feb 21 01:09:49.152929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 965/2111] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:48 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:49.481521 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b3a489cd-c2a1-4014-a80b-5d338db990c6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:49.482498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b3a489cd-c2a1-4014-a80b-5d338db990c6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:49.493205 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3a489cd-c2a1-4014-a80b-5d338db990c6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:49.493935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3a489cd-c2a1-4014-a80b-5d338db990c6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:49.495192 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3a489cd-c2a1-4014-a80b-5d338db990c6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:49.495904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3a489cd-c2a1-4014-a80b-5d338db990c6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:49.559486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b3a489cd-c2a1-4014-a80b-5d338db990c6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:49.567451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b3a489cd-c2a1-4014-a80b-5d338db990c6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092068 Feb 21 01:09:49.568104 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1147/2112] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:49 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:50.177805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c41965c4-5815-4b9a-ac8b-5631429d4418 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:50.178413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c41965c4-5815-4b9a-ac8b-5631429d4418 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:50.188287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c41965c4-5815-4b9a-ac8b-5631429d4418 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:50.188949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c41965c4-5815-4b9a-ac8b-5631429d4418 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:50.190173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c41965c4-5815-4b9a-ac8b-5631429d4418 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:50.190772 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c41965c4-5815-4b9a-ac8b-5631429d4418 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:50.336648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c41965c4-5815-4b9a-ac8b-5631429d4418 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:50.349606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c41965c4-5815-4b9a-ac8b-5631429d4418 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.177835 Feb 21 01:09:50.350144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 966/2113] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:50 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:50.584640 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7547d81c-6d11-40ca-86a9-11171197982d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:50.585259 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7547d81c-6d11-40ca-86a9-11171197982d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:50.592233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7547d81c-6d11-40ca-86a9-11171197982d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:50.593327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7547d81c-6d11-40ca-86a9-11171197982d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:50.594436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7547d81c-6d11-40ca-86a9-11171197982d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:50.594865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7547d81c-6d11-40ca-86a9-11171197982d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:50.669988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7547d81c-6d11-40ca-86a9-11171197982d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:50.678418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7547d81c-6d11-40ca-86a9-11171197982d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.097605 Feb 21 01:09:50.678991 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1148/2114] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:50 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:51.369796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3c9dbbdc-62ae-4a40-a670-274b278e4d92 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:51.370396 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3c9dbbdc-62ae-4a40-a670-274b278e4d92 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:51.380942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3c9dbbdc-62ae-4a40-a670-274b278e4d92 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:51.381646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3c9dbbdc-62ae-4a40-a670-274b278e4d92 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:51.382794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3c9dbbdc-62ae-4a40-a670-274b278e4d92 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:51.383438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3c9dbbdc-62ae-4a40-a670-274b278e4d92 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:51.523191 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3c9dbbdc-62ae-4a40-a670-274b278e4d92 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:51.531278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3c9dbbdc-62ae-4a40-a670-274b278e4d92 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166844 Feb 21 01:09:51.531848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 967/2115] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:51 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:51.703013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dcd90179-c754-4df8-a1a8-f52b3a42130b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:51.704004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dcd90179-c754-4df8-a1a8-f52b3a42130b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:51.718643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcd90179-c754-4df8-a1a8-f52b3a42130b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:51.719420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcd90179-c754-4df8-a1a8-f52b3a42130b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:51.720823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcd90179-c754-4df8-a1a8-f52b3a42130b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:51.721544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dcd90179-c754-4df8-a1a8-f52b3a42130b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:51.785873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dcd90179-c754-4df8-a1a8-f52b3a42130b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:51.794034 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dcd90179-c754-4df8-a1a8-f52b3a42130b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.097320 Feb 21 01:09:51.794602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1149/2116] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:51 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:52.548275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-35f4815f-68c4-406b-8038-0865045aaabe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:52.548925 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-35f4815f-68c4-406b-8038-0865045aaabe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:52.555623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35f4815f-68c4-406b-8038-0865045aaabe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:52.556066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35f4815f-68c4-406b-8038-0865045aaabe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:52.556878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35f4815f-68c4-406b-8038-0865045aaabe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:52.557305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35f4815f-68c4-406b-8038-0865045aaabe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:52.695782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-35f4815f-68c4-406b-8038-0865045aaabe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:52.704207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-35f4815f-68c4-406b-8038-0865045aaabe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159675 Feb 21 01:09:52.704771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 968/2117] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:52 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:52.814465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ad736bd5-e6dd-45b3-b72f-68843d5714e2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:52.815323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ad736bd5-e6dd-45b3-b72f-68843d5714e2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:52.825954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad736bd5-e6dd-45b3-b72f-68843d5714e2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:52.826698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad736bd5-e6dd-45b3-b72f-68843d5714e2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:52.828023 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad736bd5-e6dd-45b3-b72f-68843d5714e2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:52.828843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ad736bd5-e6dd-45b3-b72f-68843d5714e2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:52.890427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ad736bd5-e6dd-45b3-b72f-68843d5714e2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:52.898723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ad736bd5-e6dd-45b3-b72f-68843d5714e2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090533 Feb 21 01:09:52.899294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1150/2118] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:52 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:53.726183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dec4cf66-539b-4c0c-ba1a-944364951ba8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:53.727246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dec4cf66-539b-4c0c-ba1a-944364951ba8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:53.737886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dec4cf66-539b-4c0c-ba1a-944364951ba8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:53.738595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dec4cf66-539b-4c0c-ba1a-944364951ba8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:53.739975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dec4cf66-539b-4c0c-ba1a-944364951ba8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:53.740380 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dec4cf66-539b-4c0c-ba1a-944364951ba8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:53.884544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dec4cf66-539b-4c0c-ba1a-944364951ba8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:53.897021 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dec4cf66-539b-4c0c-ba1a-944364951ba8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176904 Feb 21 01:09:53.897811 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 969/2119] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:53 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:53.916326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4edd7627-0207-4e52-bee1-a7527f59b5a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:53.916968 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4edd7627-0207-4e52-bee1-a7527f59b5a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:53.923478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4edd7627-0207-4e52-bee1-a7527f59b5a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:53.923920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4edd7627-0207-4e52-bee1-a7527f59b5a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:53.924713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4edd7627-0207-4e52-bee1-a7527f59b5a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:53.925137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4edd7627-0207-4e52-bee1-a7527f59b5a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:53.984926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4edd7627-0207-4e52-bee1-a7527f59b5a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:53.993194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4edd7627-0207-4e52-bee1-a7527f59b5a5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081038 Feb 21 01:09:53.993754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1151/2120] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:53 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:54.917625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-51e3c1d7-e2f0-4826-9a06-32f0c203cc56 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:54.918491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-51e3c1d7-e2f0-4826-9a06-32f0c203cc56 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:54.927732 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-51e3c1d7-e2f0-4826-9a06-32f0c203cc56 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:54.928173 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-51e3c1d7-e2f0-4826-9a06-32f0c203cc56 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:54.928976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-51e3c1d7-e2f0-4826-9a06-32f0c203cc56 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:54.929398 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-51e3c1d7-e2f0-4826-9a06-32f0c203cc56 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:55.010186 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-487e193c-abe8-43ca-88ee-85572df01d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:55.010904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-487e193c-abe8-43ca-88ee-85572df01d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:55.017964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-487e193c-abe8-43ca-88ee-85572df01d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:55.018406 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-487e193c-abe8-43ca-88ee-85572df01d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:55.019175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-487e193c-abe8-43ca-88ee-85572df01d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:55.019598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-487e193c-abe8-43ca-88ee-85572df01d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:55.068218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-51e3c1d7-e2f0-4826-9a06-32f0c203cc56 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:55.076256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-51e3c1d7-e2f0-4826-9a06-32f0c203cc56 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164769 Feb 21 01:09:55.076829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 970/2121] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:54 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:55.080904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-487e193c-abe8-43ca-88ee-85572df01d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:55.089154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-487e193c-abe8-43ca-88ee-85572df01d45 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082760 Feb 21 01:09:55.089709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1152/2122] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:55 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:56.097321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bcf7aa72-c8e5-4a61-a0f1-4671a184564e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:56.098387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bcf7aa72-c8e5-4a61-a0f1-4671a184564e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:56.105401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8b11d742-dced-401b-a4b5-556413fb8ada tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:56.105931 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bcf7aa72-c8e5-4a61-a0f1-4671a184564e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:56.106040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8b11d742-dced-401b-a4b5-556413fb8ada tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:56.106147 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bcf7aa72-c8e5-4a61-a0f1-4671a184564e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:56.106903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bcf7aa72-c8e5-4a61-a0f1-4671a184564e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:56.107336 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bcf7aa72-c8e5-4a61-a0f1-4671a184564e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:56.112261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b11d742-dced-401b-a4b5-556413fb8ada tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:56.112758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b11d742-dced-401b-a4b5-556413fb8ada tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:56.113538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b11d742-dced-401b-a4b5-556413fb8ada tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:56.113974 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b11d742-dced-401b-a4b5-556413fb8ada tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:56.173062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8b11d742-dced-401b-a4b5-556413fb8ada tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:56.180998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8b11d742-dced-401b-a4b5-556413fb8ada tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.079230 Feb 21 01:09:56.181571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1153/2123] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:56 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:56.238945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bcf7aa72-c8e5-4a61-a0f1-4671a184564e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:56.246704 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bcf7aa72-c8e5-4a61-a0f1-4671a184564e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.155649 Feb 21 01:09:56.247278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 971/2124] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:56 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:57.201780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-12749b69-ae91-4590-9c8c-ff9d823bc28f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:57.202801 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-12749b69-ae91-4590-9c8c-ff9d823bc28f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:57.211719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-12749b69-ae91-4590-9c8c-ff9d823bc28f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:57.212130 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-12749b69-ae91-4590-9c8c-ff9d823bc28f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:57.212977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-12749b69-ae91-4590-9c8c-ff9d823bc28f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:57.213429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-12749b69-ae91-4590-9c8c-ff9d823bc28f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:57.263822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e7447884-3559-4b32-9aa4-be784810254f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:57.264414 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e7447884-3559-4b32-9aa4-be784810254f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:57.271617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7447884-3559-4b32-9aa4-be784810254f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:57.272029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7447884-3559-4b32-9aa4-be784810254f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:57.272837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7447884-3559-4b32-9aa4-be784810254f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:57.273262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e7447884-3559-4b32-9aa4-be784810254f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:57.278214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-12749b69-ae91-4590-9c8c-ff9d823bc28f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:57.286646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-12749b69-ae91-4590-9c8c-ff9d823bc28f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091030 Feb 21 01:09:57.287247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1154/2125] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:57 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:57.405288 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e7447884-3559-4b32-9aa4-be784810254f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:57.414555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e7447884-3559-4b32-9aa4-be784810254f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.154567 Feb 21 01:09:57.415207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 972/2126] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:57 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:58.304748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4e430e50-966d-455d-a838-deac95bf7faf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:58.305426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4e430e50-966d-455d-a838-deac95bf7faf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:58.313032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4e430e50-966d-455d-a838-deac95bf7faf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:58.313557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4e430e50-966d-455d-a838-deac95bf7faf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:58.314468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4e430e50-966d-455d-a838-deac95bf7faf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:58.314969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4e430e50-966d-455d-a838-deac95bf7faf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:58.375167 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4e430e50-966d-455d-a838-deac95bf7faf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:58.383164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4e430e50-966d-455d-a838-deac95bf7faf tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082941 Feb 21 01:09:58.383735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1155/2127] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:58 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:09:58.431269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3cfe61ed-91cc-4e59-b8a6-911af7d84320 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:58.431896 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3cfe61ed-91cc-4e59-b8a6-911af7d84320 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:58.439129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cfe61ed-91cc-4e59-b8a6-911af7d84320 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:58.439565 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cfe61ed-91cc-4e59-b8a6-911af7d84320 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:58.440344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cfe61ed-91cc-4e59-b8a6-911af7d84320 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:58.440813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3cfe61ed-91cc-4e59-b8a6-911af7d84320 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:58.582100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3cfe61ed-91cc-4e59-b8a6-911af7d84320 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:58.594315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3cfe61ed-91cc-4e59-b8a6-911af7d84320 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.166525 Feb 21 01:09:58.595095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 973/2128] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:58 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:59.403763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bfaee15c-74d6-47da-a015-83050f7d2cc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:59.404814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bfaee15c-74d6-47da-a015-83050f7d2cc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:59.415321 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bfaee15c-74d6-47da-a015-83050f7d2cc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:59.416066 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bfaee15c-74d6-47da-a015-83050f7d2cc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:59.417398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bfaee15c-74d6-47da-a015-83050f7d2cc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:59.418118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bfaee15c-74d6-47da-a015-83050f7d2cc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:59.481573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bfaee15c-74d6-47da-a015-83050f7d2cc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:59.491098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bfaee15c-74d6-47da-a015-83050f7d2cc6 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093479 Feb 21 01:09:59.491695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1156/2129] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:59 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:09:59.611735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-379432d7-711e-438c-ae25-57af2d6d2d6d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:09:59.612318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-379432d7-711e-438c-ae25-57af2d6d2d6d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:09:59.619328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-379432d7-711e-438c-ae25-57af2d6d2d6d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:59.619891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-379432d7-711e-438c-ae25-57af2d6d2d6d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:59.620822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-379432d7-711e-438c-ae25-57af2d6d2d6d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:09:59.621360 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-379432d7-711e-438c-ae25-57af2d6d2d6d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:09:59.772426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-379432d7-711e-438c-ae25-57af2d6d2d6d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:09:59.780889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-379432d7-711e-438c-ae25-57af2d6d2d6d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172959 Feb 21 01:09:59.781497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 974/2130] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:09:59 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:00.507223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-1654dd24-c894-42d9-a640-d9cd8db9365f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:00.507833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-1654dd24-c894-42d9-a640-d9cd8db9365f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:00.514031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1654dd24-c894-42d9-a640-d9cd8db9365f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:00.514464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1654dd24-c894-42d9-a640-d9cd8db9365f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:00.515234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1654dd24-c894-42d9-a640-d9cd8db9365f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:00.515661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-1654dd24-c894-42d9-a640-d9cd8db9365f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:00.579478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-1654dd24-c894-42d9-a640-d9cd8db9365f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:00.587600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-1654dd24-c894-42d9-a640-d9cd8db9365f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084135 Feb 21 01:10:00.588179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1157/2131] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:00 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:00.798413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-833e2eef-534a-4d6b-922b-74e4dc5c2527 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:00.799051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-833e2eef-534a-4d6b-922b-74e4dc5c2527 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:00.805782 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-833e2eef-534a-4d6b-922b-74e4dc5c2527 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:00.806220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-833e2eef-534a-4d6b-922b-74e4dc5c2527 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:00.806995 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-833e2eef-534a-4d6b-922b-74e4dc5c2527 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:00.807417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-833e2eef-534a-4d6b-922b-74e4dc5c2527 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:00.967962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-833e2eef-534a-4d6b-922b-74e4dc5c2527 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:00.980378 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-833e2eef-534a-4d6b-922b-74e4dc5c2527 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.185532 Feb 21 01:10:00.981121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 975/2132] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:00 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:01.608582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fa17f6d3-fa89-42d9-b0a6-bc0bdb8efe52 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:01.609561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fa17f6d3-fa89-42d9-b0a6-bc0bdb8efe52 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:01.620279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fa17f6d3-fa89-42d9-b0a6-bc0bdb8efe52 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:01.621112 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fa17f6d3-fa89-42d9-b0a6-bc0bdb8efe52 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:01.622391 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fa17f6d3-fa89-42d9-b0a6-bc0bdb8efe52 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:01.623089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fa17f6d3-fa89-42d9-b0a6-bc0bdb8efe52 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:01.694608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fa17f6d3-fa89-42d9-b0a6-bc0bdb8efe52 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:01.706345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fa17f6d3-fa89-42d9-b0a6-bc0bdb8efe52 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.103905 Feb 21 01:10:01.707150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1158/2133] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:01 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:02.003094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4b8cbbdd-b3ef-49a4-9b9f-10e4d886fe67 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:02.004027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4b8cbbdd-b3ef-49a4-9b9f-10e4d886fe67 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:02.014972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b8cbbdd-b3ef-49a4-9b9f-10e4d886fe67 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:02.015748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b8cbbdd-b3ef-49a4-9b9f-10e4d886fe67 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:02.017041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b8cbbdd-b3ef-49a4-9b9f-10e4d886fe67 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:02.017758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4b8cbbdd-b3ef-49a4-9b9f-10e4d886fe67 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:02.166206 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4b8cbbdd-b3ef-49a4-9b9f-10e4d886fe67 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:02.174499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4b8cbbdd-b3ef-49a4-9b9f-10e4d886fe67 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.177709 Feb 21 01:10:02.175067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 976/2134] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:01 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:02.725605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e87d2d67-f043-4271-b86d-51f090543d12 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:02.726301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e87d2d67-f043-4271-b86d-51f090543d12 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:02.734380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e87d2d67-f043-4271-b86d-51f090543d12 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:02.734898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e87d2d67-f043-4271-b86d-51f090543d12 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:02.735812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e87d2d67-f043-4271-b86d-51f090543d12 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:02.736324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e87d2d67-f043-4271-b86d-51f090543d12 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:02.800037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e87d2d67-f043-4271-b86d-51f090543d12 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:02.812836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e87d2d67-f043-4271-b86d-51f090543d12 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091380 Feb 21 01:10:02.813644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1159/2135] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:02 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:03.197900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f6a72a2b-3947-4763-94c7-1029b3031d95 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:03.198834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f6a72a2b-3947-4763-94c7-1029b3031d95 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:03.209189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6a72a2b-3947-4763-94c7-1029b3031d95 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:03.209634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6a72a2b-3947-4763-94c7-1029b3031d95 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:03.210459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6a72a2b-3947-4763-94c7-1029b3031d95 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:03.210918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f6a72a2b-3947-4763-94c7-1029b3031d95 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:03.345029 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f6a72a2b-3947-4763-94c7-1029b3031d95 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:03.353596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f6a72a2b-3947-4763-94c7-1029b3031d95 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162316 Feb 21 01:10:03.354142 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 977/2136] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:03 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:03.831847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-935f9341-9217-4661-9db0-6f4a77a66189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:03.832452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-935f9341-9217-4661-9db0-6f4a77a66189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:03.839228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-935f9341-9217-4661-9db0-6f4a77a66189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:03.839642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-935f9341-9217-4661-9db0-6f4a77a66189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:03.840465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-935f9341-9217-4661-9db0-6f4a77a66189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:03.840900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-935f9341-9217-4661-9db0-6f4a77a66189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:03.913098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-935f9341-9217-4661-9db0-6f4a77a66189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:03.921481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-935f9341-9217-4661-9db0-6f4a77a66189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093901 Feb 21 01:10:03.922078 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1160/2137] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:03 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:04.374858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c9e10157-c191-4557-ad56-926c7baade53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:04.375808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c9e10157-c191-4557-ad56-926c7baade53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:04.384792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c9e10157-c191-4557-ad56-926c7baade53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:04.385234 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c9e10157-c191-4557-ad56-926c7baade53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:04.386015 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c9e10157-c191-4557-ad56-926c7baade53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:04.386442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c9e10157-c191-4557-ad56-926c7baade53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:04.533707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c9e10157-c191-4557-ad56-926c7baade53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:04.542210 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c9e10157-c191-4557-ad56-926c7baade53 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173620 Feb 21 01:10:04.542775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 978/2138] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:04 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:04.942773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f2495240-78de-4538-8e15-274b4f8b8f9e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:04.943705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f2495240-78de-4538-8e15-274b4f8b8f9e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:04.954474 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2495240-78de-4538-8e15-274b4f8b8f9e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:04.955220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2495240-78de-4538-8e15-274b4f8b8f9e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:04.956604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2495240-78de-4538-8e15-274b4f8b8f9e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:04.957336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f2495240-78de-4538-8e15-274b4f8b8f9e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:05.033920 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f2495240-78de-4538-8e15-274b4f8b8f9e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:05.042299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f2495240-78de-4538-8e15-274b4f8b8f9e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.105950 Feb 21 01:10:05.042896 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1161/2139] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:04 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:05.561741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0d0edbd7-3da1-4de7-a99e-e529ce67eefc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:05.562323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0d0edbd7-3da1-4de7-a99e-e529ce67eefc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:05.569856 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d0edbd7-3da1-4de7-a99e-e529ce67eefc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:05.570304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d0edbd7-3da1-4de7-a99e-e529ce67eefc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:05.571082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d0edbd7-3da1-4de7-a99e-e529ce67eefc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:05.571626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d0edbd7-3da1-4de7-a99e-e529ce67eefc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:05.721211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0d0edbd7-3da1-4de7-a99e-e529ce67eefc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:05.733273 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0d0edbd7-3da1-4de7-a99e-e529ce67eefc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176590 Feb 21 01:10:05.734144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 979/2140] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:05 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:06.063487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-97459b4f-8e01-4469-b7ee-8f1aca184670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:06.064611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-97459b4f-8e01-4469-b7ee-8f1aca184670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:06.073049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-97459b4f-8e01-4469-b7ee-8f1aca184670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:06.073497 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-97459b4f-8e01-4469-b7ee-8f1aca184670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:06.074306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-97459b4f-8e01-4469-b7ee-8f1aca184670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:06.074727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-97459b4f-8e01-4469-b7ee-8f1aca184670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:06.146545 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-97459b4f-8e01-4469-b7ee-8f1aca184670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:06.154843 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-97459b4f-8e01-4469-b7ee-8f1aca184670 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.097689 Feb 21 01:10:06.155418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1162/2141] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:06 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:06.759749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-36d71450-8c7f-4518-b0e0-e1894e0c7fb9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:06.760749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-36d71450-8c7f-4518-b0e0-e1894e0c7fb9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:06.771751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-36d71450-8c7f-4518-b0e0-e1894e0c7fb9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:06.772525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-36d71450-8c7f-4518-b0e0-e1894e0c7fb9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:06.773792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-36d71450-8c7f-4518-b0e0-e1894e0c7fb9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:06.774466 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-36d71450-8c7f-4518-b0e0-e1894e0c7fb9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:06.918937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-36d71450-8c7f-4518-b0e0-e1894e0c7fb9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:06.927829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-36d71450-8c7f-4518-b0e0-e1894e0c7fb9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.174423 Feb 21 01:10:06.928515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 980/2142] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:06 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:07.175500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8cf00282-0c68-48da-99f2-22f7129072a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:07.176290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8cf00282-0c68-48da-99f2-22f7129072a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:07.183758 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cf00282-0c68-48da-99f2-22f7129072a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:07.184207 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cf00282-0c68-48da-99f2-22f7129072a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:07.185020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cf00282-0c68-48da-99f2-22f7129072a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:07.185449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8cf00282-0c68-48da-99f2-22f7129072a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:07.249605 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8cf00282-0c68-48da-99f2-22f7129072a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:07.257886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8cf00282-0c68-48da-99f2-22f7129072a4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088405 Feb 21 01:10:07.258458 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1163/2143] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:07 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:07.949474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-33f09c91-c4a7-48c5-94a9-611556a6dd02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:07.950358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-33f09c91-c4a7-48c5-94a9-611556a6dd02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:07.960613 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-33f09c91-c4a7-48c5-94a9-611556a6dd02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:07.961063 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-33f09c91-c4a7-48c5-94a9-611556a6dd02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:07.961858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-33f09c91-c4a7-48c5-94a9-611556a6dd02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:07.962287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-33f09c91-c4a7-48c5-94a9-611556a6dd02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:08.113654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-33f09c91-c4a7-48c5-94a9-611556a6dd02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:08.122501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-33f09c91-c4a7-48c5-94a9-611556a6dd02 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.179538 Feb 21 01:10:08.123067 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 981/2144] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:07 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:08.278384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3572dd1e-72ee-4d82-a32b-26cb712e9dac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:08.279357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3572dd1e-72ee-4d82-a32b-26cb712e9dac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:08.289129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3572dd1e-72ee-4d82-a32b-26cb712e9dac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:08.289574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3572dd1e-72ee-4d82-a32b-26cb712e9dac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:08.290366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3572dd1e-72ee-4d82-a32b-26cb712e9dac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:08.290789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3572dd1e-72ee-4d82-a32b-26cb712e9dac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:08.351743 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3572dd1e-72ee-4d82-a32b-26cb712e9dac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:08.359945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3572dd1e-72ee-4d82-a32b-26cb712e9dac tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088070 Feb 21 01:10:08.360547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1164/2145] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:08 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:09.145941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a196ca53-ba7b-424f-af0b-36f6ea27335d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:09.146927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a196ca53-ba7b-424f-af0b-36f6ea27335d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:09.153841 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a196ca53-ba7b-424f-af0b-36f6ea27335d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.154309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a196ca53-ba7b-424f-af0b-36f6ea27335d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.155093 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a196ca53-ba7b-424f-af0b-36f6ea27335d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.155548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a196ca53-ba7b-424f-af0b-36f6ea27335d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.300916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a196ca53-ba7b-424f-af0b-36f6ea27335d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:09.309399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a196ca53-ba7b-424f-af0b-36f6ea27335d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.170148 Feb 21 01:10:09.310024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 982/2146] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:09 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:09.383822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f634852f-6cb3-488c-a0ee-8de538559c3d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:09.384873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f634852f-6cb3-488c-a0ee-8de538559c3d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:09.395766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f634852f-6cb3-488c-a0ee-8de538559c3d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.396695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f634852f-6cb3-488c-a0ee-8de538559c3d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.397628 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f634852f-6cb3-488c-a0ee-8de538559c3d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:09.398055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f634852f-6cb3-488c-a0ee-8de538559c3d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:09.458347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f634852f-6cb3-488c-a0ee-8de538559c3d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:09.466840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f634852f-6cb3-488c-a0ee-8de538559c3d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089296 Feb 21 01:10:09.467398 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1165/2147] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:09 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:10.334740 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8ef9a566-88d0-4115-8036-bf23a9295425 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:10.335745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8ef9a566-88d0-4115-8036-bf23a9295425 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:10.346509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ef9a566-88d0-4115-8036-bf23a9295425 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:10.347236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ef9a566-88d0-4115-8036-bf23a9295425 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:10.348766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ef9a566-88d0-4115-8036-bf23a9295425 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:10.349472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8ef9a566-88d0-4115-8036-bf23a9295425 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:10.483837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-53fe277d-8314-4bd0-8df2-57d6229bcbd3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:10.484479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-53fe277d-8314-4bd0-8df2-57d6229bcbd3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:10.484822 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8ef9a566-88d0-4115-8036-bf23a9295425 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:10.491245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53fe277d-8314-4bd0-8df2-57d6229bcbd3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:10.491691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53fe277d-8314-4bd0-8df2-57d6229bcbd3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:10.492490 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53fe277d-8314-4bd0-8df2-57d6229bcbd3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:10.492860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8ef9a566-88d0-4115-8036-bf23a9295425 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164372 Feb 21 01:10:10.493010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53fe277d-8314-4bd0-8df2-57d6229bcbd3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:10.493438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 983/2148] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:10 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:10.561017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-53fe277d-8314-4bd0-8df2-57d6229bcbd3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:10.569281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-53fe277d-8314-4bd0-8df2-57d6229bcbd3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089207 Feb 21 01:10:10.569862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1166/2149] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:10 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:11.514621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2629b1f9-42a2-4e09-931a-79e9d4e73354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:11.515250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2629b1f9-42a2-4e09-931a-79e9d4e73354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:11.522190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2629b1f9-42a2-4e09-931a-79e9d4e73354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:11.522718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2629b1f9-42a2-4e09-931a-79e9d4e73354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:11.523507 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2629b1f9-42a2-4e09-931a-79e9d4e73354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:11.523941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2629b1f9-42a2-4e09-931a-79e9d4e73354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:11.586233 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-56cfd6ab-37a1-48c0-8ed4-5aa1610c089d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:11.586854 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-56cfd6ab-37a1-48c0-8ed4-5aa1610c089d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:11.593583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56cfd6ab-37a1-48c0-8ed4-5aa1610c089d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:11.594069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56cfd6ab-37a1-48c0-8ed4-5aa1610c089d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:11.594848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56cfd6ab-37a1-48c0-8ed4-5aa1610c089d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:11.595413 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56cfd6ab-37a1-48c0-8ed4-5aa1610c089d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:11.658690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-56cfd6ab-37a1-48c0-8ed4-5aa1610c089d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:11.666775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-56cfd6ab-37a1-48c0-8ed4-5aa1610c089d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084298 Feb 21 01:10:11.667362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1167/2150] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:11 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:11.668295 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2629b1f9-42a2-4e09-931a-79e9d4e73354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:11.676586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2629b1f9-42a2-4e09-931a-79e9d4e73354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165766 Feb 21 01:10:11.677172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 984/2151] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:11 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:12.689202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a377e855-574a-4000-899b-14b79a5bd1be tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:12.689202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a377e855-574a-4000-899b-14b79a5bd1be tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:12.695991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9dff71aa-492e-4b23-b54e-63c7d5bee466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:12.696702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9dff71aa-492e-4b23-b54e-63c7d5bee466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:12.696945 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a377e855-574a-4000-899b-14b79a5bd1be tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:12.697385 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a377e855-574a-4000-899b-14b79a5bd1be tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:12.698160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a377e855-574a-4000-899b-14b79a5bd1be tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:12.698580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a377e855-574a-4000-899b-14b79a5bd1be tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:12.703300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9dff71aa-492e-4b23-b54e-63c7d5bee466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:12.703754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9dff71aa-492e-4b23-b54e-63c7d5bee466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:12.704573 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9dff71aa-492e-4b23-b54e-63c7d5bee466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:12.705012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9dff71aa-492e-4b23-b54e-63c7d5bee466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:12.758483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a377e855-574a-4000-899b-14b79a5bd1be tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:12.766619 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a377e855-574a-4000-899b-14b79a5bd1be tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085939 Feb 21 01:10:12.767210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1168/2152] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:12 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:12.845595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9dff71aa-492e-4b23-b54e-63c7d5bee466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:12.854436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9dff71aa-492e-4b23-b54e-63c7d5bee466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163334 Feb 21 01:10:12.855282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 985/2153] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:12 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:13.787228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-598fc6eb-7f7a-41cc-b7e6-55f0ae36e4ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:13.788090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-598fc6eb-7f7a-41cc-b7e6-55f0ae36e4ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:13.798913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-598fc6eb-7f7a-41cc-b7e6-55f0ae36e4ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:13.799646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-598fc6eb-7f7a-41cc-b7e6-55f0ae36e4ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:13.800989 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-598fc6eb-7f7a-41cc-b7e6-55f0ae36e4ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:13.801703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-598fc6eb-7f7a-41cc-b7e6-55f0ae36e4ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:13.863718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-598fc6eb-7f7a-41cc-b7e6-55f0ae36e4ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:13.872711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-598fc6eb-7f7a-41cc-b7e6-55f0ae36e4ce tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091930 Feb 21 01:10:13.873529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1169/2154] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:13 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:13.875247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4a17bb55-a445-4779-b919-3b57e38b8347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:13.875876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4a17bb55-a445-4779-b919-3b57e38b8347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:13.883163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a17bb55-a445-4779-b919-3b57e38b8347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:13.883610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a17bb55-a445-4779-b919-3b57e38b8347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:13.884427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a17bb55-a445-4779-b919-3b57e38b8347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:13.884875 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a17bb55-a445-4779-b919-3b57e38b8347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:14.027787 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4a17bb55-a445-4779-b919-3b57e38b8347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:14.039795 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4a17bb55-a445-4779-b919-3b57e38b8347 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168377 Feb 21 01:10:14.040264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 986/2155] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:13 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:14.893632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-039588d1-dfa4-4a37-8a64-1c56b98d976f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:14.894529 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-039588d1-dfa4-4a37-8a64-1c56b98d976f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:14.905816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-039588d1-dfa4-4a37-8a64-1c56b98d976f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:14.906522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-039588d1-dfa4-4a37-8a64-1c56b98d976f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:14.907798 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-039588d1-dfa4-4a37-8a64-1c56b98d976f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:14.908565 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-039588d1-dfa4-4a37-8a64-1c56b98d976f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:14.973672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-039588d1-dfa4-4a37-8a64-1c56b98d976f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:14.981996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-039588d1-dfa4-4a37-8a64-1c56b98d976f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.094687 Feb 21 01:10:14.982799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1170/2156] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:14 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:15.057501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-63cfbb03-828b-4135-ac06-75e8cb8d7cc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:15.058198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-63cfbb03-828b-4135-ac06-75e8cb8d7cc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:15.065017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63cfbb03-828b-4135-ac06-75e8cb8d7cc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:15.065469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63cfbb03-828b-4135-ac06-75e8cb8d7cc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:15.066285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63cfbb03-828b-4135-ac06-75e8cb8d7cc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:15.066715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63cfbb03-828b-4135-ac06-75e8cb8d7cc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:15.202183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-63cfbb03-828b-4135-ac06-75e8cb8d7cc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:15.210125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-63cfbb03-828b-4135-ac06-75e8cb8d7cc3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.157133 Feb 21 01:10:15.210687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 987/2157] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:15 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:16.003014 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b6ef645e-d104-4c58-a663-9fd553e035ad tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:16.004027 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b6ef645e-d104-4c58-a663-9fd553e035ad tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:16.015036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6ef645e-d104-4c58-a663-9fd553e035ad tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:16.015773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6ef645e-d104-4c58-a663-9fd553e035ad tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:16.017116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6ef645e-d104-4c58-a663-9fd553e035ad tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:16.017832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b6ef645e-d104-4c58-a663-9fd553e035ad tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:16.080426 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b6ef645e-d104-4c58-a663-9fd553e035ad tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:16.088771 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b6ef645e-d104-4c58-a663-9fd553e035ad tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092095 Feb 21 01:10:16.089358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1171/2158] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:15 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:16.231075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f4a9485b-e2b8-40f0-b281-2970a390e86d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:16.232035 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f4a9485b-e2b8-40f0-b281-2970a390e86d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:16.242653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4a9485b-e2b8-40f0-b281-2970a390e86d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:16.243385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4a9485b-e2b8-40f0-b281-2970a390e86d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:16.244731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4a9485b-e2b8-40f0-b281-2970a390e86d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:16.245465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f4a9485b-e2b8-40f0-b281-2970a390e86d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:16.399445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f4a9485b-e2b8-40f0-b281-2970a390e86d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:16.412750 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f4a9485b-e2b8-40f0-b281-2970a390e86d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.187816 Feb 21 01:10:16.413332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 988/2159] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:16 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:17.106098 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-290c114c-4005-4fd6-9330-943a3f7acb8c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:17.106724 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-290c114c-4005-4fd6-9330-943a3f7acb8c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:17.113644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-290c114c-4005-4fd6-9330-943a3f7acb8c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.114086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-290c114c-4005-4fd6-9330-943a3f7acb8c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:17.114853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-290c114c-4005-4fd6-9330-943a3f7acb8c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.115264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-290c114c-4005-4fd6-9330-943a3f7acb8c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:17.179648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-290c114c-4005-4fd6-9330-943a3f7acb8c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:17.187452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-290c114c-4005-4fd6-9330-943a3f7acb8c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085175 Feb 21 01:10:17.188039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1172/2160] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:17 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:17.431860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2bcbb3d9-d6bd-4807-93b3-57278903d4f1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:17.432439 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2bcbb3d9-d6bd-4807-93b3-57278903d4f1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:17.439167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2bcbb3d9-d6bd-4807-93b3-57278903d4f1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.439611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2bcbb3d9-d6bd-4807-93b3-57278903d4f1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:17.440436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2bcbb3d9-d6bd-4807-93b3-57278903d4f1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:17.440883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2bcbb3d9-d6bd-4807-93b3-57278903d4f1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:17.586584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2bcbb3d9-d6bd-4807-93b3-57278903d4f1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:17.594543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2bcbb3d9-d6bd-4807-93b3-57278903d4f1 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.167215 Feb 21 01:10:17.595152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 989/2161] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:17 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:18.208470 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ade19e1a-718b-4997-be18-979bdbed4573 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:18.209478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ade19e1a-718b-4997-be18-979bdbed4573 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:18.217411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ade19e1a-718b-4997-be18-979bdbed4573 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:18.217939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ade19e1a-718b-4997-be18-979bdbed4573 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.218842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ade19e1a-718b-4997-be18-979bdbed4573 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:18.219350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ade19e1a-718b-4997-be18-979bdbed4573 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.283904 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ade19e1a-718b-4997-be18-979bdbed4573 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:18.292280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ade19e1a-718b-4997-be18-979bdbed4573 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090044 Feb 21 01:10:18.292901 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1173/2162] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:18 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:18.615897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8f80c921-2a1a-4c4a-af4c-72fd7e6ae042 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:18.616932 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8f80c921-2a1a-4c4a-af4c-72fd7e6ae042 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:18.627555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8f80c921-2a1a-4c4a-af4c-72fd7e6ae042 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:18.628285 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8f80c921-2a1a-4c4a-af4c-72fd7e6ae042 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.629601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8f80c921-2a1a-4c4a-af4c-72fd7e6ae042 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:18.630300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8f80c921-2a1a-4c4a-af4c-72fd7e6ae042 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:18.770628 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8f80c921-2a1a-4c4a-af4c-72fd7e6ae042 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:18.778612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8f80c921-2a1a-4c4a-af4c-72fd7e6ae042 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168811 Feb 21 01:10:18.779107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 990/2163] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:18 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:19.313664 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9c52736d-4a85-4d1d-8d2d-f4775f83e1dc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:19.315432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9c52736d-4a85-4d1d-8d2d-f4775f83e1dc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:19.323263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c52736d-4a85-4d1d-8d2d-f4775f83e1dc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:19.323702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c52736d-4a85-4d1d-8d2d-f4775f83e1dc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:19.324498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c52736d-4a85-4d1d-8d2d-f4775f83e1dc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:19.324931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9c52736d-4a85-4d1d-8d2d-f4775f83e1dc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:19.387049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9c52736d-4a85-4d1d-8d2d-f4775f83e1dc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:19.395719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9c52736d-4a85-4d1d-8d2d-f4775f83e1dc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088654 Feb 21 01:10:19.396284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1174/2164] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:19 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:19.799547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-621af53e-3181-4ed5-b7b0-12696383b717 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:19.800591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-621af53e-3181-4ed5-b7b0-12696383b717 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:19.808769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-621af53e-3181-4ed5-b7b0-12696383b717 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:19.809259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-621af53e-3181-4ed5-b7b0-12696383b717 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:19.810111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-621af53e-3181-4ed5-b7b0-12696383b717 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:19.810583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-621af53e-3181-4ed5-b7b0-12696383b717 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:19.958773 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-621af53e-3181-4ed5-b7b0-12696383b717 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:19.969851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-621af53e-3181-4ed5-b7b0-12696383b717 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176141 Feb 21 01:10:19.970587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 991/2165] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:19 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:20.415827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8d874a4d-4e29-41d6-8f75-13aed50316f9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:20.416825 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8d874a4d-4e29-41d6-8f75-13aed50316f9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:20.427443 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8d874a4d-4e29-41d6-8f75-13aed50316f9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:20.428134 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8d874a4d-4e29-41d6-8f75-13aed50316f9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:20.428935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8d874a4d-4e29-41d6-8f75-13aed50316f9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:20.429359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8d874a4d-4e29-41d6-8f75-13aed50316f9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:20.487716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8d874a4d-4e29-41d6-8f75-13aed50316f9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:20.495780 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8d874a4d-4e29-41d6-8f75-13aed50316f9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086140 Feb 21 01:10:20.496333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1175/2166] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:20 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:20.993127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c145783e-4e8e-4e11-bcde-73d227ed86a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:20.994135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c145783e-4e8e-4e11-bcde-73d227ed86a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:21.004752 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c145783e-4e8e-4e11-bcde-73d227ed86a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:21.005497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c145783e-4e8e-4e11-bcde-73d227ed86a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:21.006516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c145783e-4e8e-4e11-bcde-73d227ed86a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:21.006947 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c145783e-4e8e-4e11-bcde-73d227ed86a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:21.162356 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c145783e-4e8e-4e11-bcde-73d227ed86a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:21.171189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c145783e-4e8e-4e11-bcde-73d227ed86a3 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.184673 Feb 21 01:10:21.171765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 992/2167] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:20 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:21.516671 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e58b3b50-017f-4624-841f-bf8c74a9ff41 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:21.517666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e58b3b50-017f-4624-841f-bf8c74a9ff41 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:21.528944 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e58b3b50-017f-4624-841f-bf8c74a9ff41 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:21.530169 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e58b3b50-017f-4624-841f-bf8c74a9ff41 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:21.530929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e58b3b50-017f-4624-841f-bf8c74a9ff41 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:21.531646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e58b3b50-017f-4624-841f-bf8c74a9ff41 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:21.593794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e58b3b50-017f-4624-841f-bf8c74a9ff41 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:21.603196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e58b3b50-017f-4624-841f-bf8c74a9ff41 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092446 Feb 21 01:10:21.604216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1176/2168] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:21 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:22.192569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-83c23883-d0c5-4d9b-a641-37fdab2e5d40 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:22.193525 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-83c23883-d0c5-4d9b-a641-37fdab2e5d40 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:22.204095 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83c23883-d0c5-4d9b-a641-37fdab2e5d40 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:22.204877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83c23883-d0c5-4d9b-a641-37fdab2e5d40 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:22.206144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83c23883-d0c5-4d9b-a641-37fdab2e5d40 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:22.206855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-83c23883-d0c5-4d9b-a641-37fdab2e5d40 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:22.343317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-83c23883-d0c5-4d9b-a641-37fdab2e5d40 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:22.351346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-83c23883-d0c5-4d9b-a641-37fdab2e5d40 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165132 Feb 21 01:10:22.351913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 993/2169] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:22 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:22.624982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fb96d10a-2c6a-4eef-ad26-2acf7a89e0e5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:22.625980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fb96d10a-2c6a-4eef-ad26-2acf7a89e0e5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:22.636698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb96d10a-2c6a-4eef-ad26-2acf7a89e0e5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:22.637424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb96d10a-2c6a-4eef-ad26-2acf7a89e0e5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:22.638795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb96d10a-2c6a-4eef-ad26-2acf7a89e0e5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:22.639493 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fb96d10a-2c6a-4eef-ad26-2acf7a89e0e5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:22.704711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fb96d10a-2c6a-4eef-ad26-2acf7a89e0e5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:22.712763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fb96d10a-2c6a-4eef-ad26-2acf7a89e0e5 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093943 Feb 21 01:10:22.713320 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1177/2170] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:22 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:23.371249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8504e378-44dc-451c-87b3-7f7f1e7a24db tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:23.371988 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8504e378-44dc-451c-87b3-7f7f1e7a24db tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:23.380249 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8504e378-44dc-451c-87b3-7f7f1e7a24db tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:23.380836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8504e378-44dc-451c-87b3-7f7f1e7a24db tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:23.381798 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8504e378-44dc-451c-87b3-7f7f1e7a24db tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:23.382332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8504e378-44dc-451c-87b3-7f7f1e7a24db tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:23.536768 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8504e378-44dc-451c-87b3-7f7f1e7a24db tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:23.545168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8504e378-44dc-451c-87b3-7f7f1e7a24db tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.178607 Feb 21 01:10:23.545737 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 994/2171] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:23 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:23.733402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8386ee53-5065-4182-8d92-96976fbf198b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:23.734227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8386ee53-5065-4182-8d92-96976fbf198b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:23.744967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8386ee53-5065-4182-8d92-96976fbf198b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:23.745698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8386ee53-5065-4182-8d92-96976fbf198b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:23.746941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8386ee53-5065-4182-8d92-96976fbf198b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:23.747661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8386ee53-5065-4182-8d92-96976fbf198b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:23.814511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8386ee53-5065-4182-8d92-96976fbf198b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:23.822468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8386ee53-5065-4182-8d92-96976fbf198b tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.095424 Feb 21 01:10:23.823050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1178/2172] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:23 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:24.562654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-70e132f3-4798-42ae-8d71-d3d28d2a4485 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:24.563272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-70e132f3-4798-42ae-8d71-d3d28d2a4485 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:24.570244 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-70e132f3-4798-42ae-8d71-d3d28d2a4485 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:24.570689 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-70e132f3-4798-42ae-8d71-d3d28d2a4485 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:24.571463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-70e132f3-4798-42ae-8d71-d3d28d2a4485 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:24.571888 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-70e132f3-4798-42ae-8d71-d3d28d2a4485 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:24.722688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-70e132f3-4798-42ae-8d71-d3d28d2a4485 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:24.731335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-70e132f3-4798-42ae-8d71-d3d28d2a4485 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172552 Feb 21 01:10:24.731898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 995/2173] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:24 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:24.842846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dd03a550-5eeb-403b-8ca2-c03cb3d7b672 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:24.843708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dd03a550-5eeb-403b-8ca2-c03cb3d7b672 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:24.852159 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd03a550-5eeb-403b-8ca2-c03cb3d7b672 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:24.852637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd03a550-5eeb-403b-8ca2-c03cb3d7b672 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:24.853456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd03a550-5eeb-403b-8ca2-c03cb3d7b672 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:24.853934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dd03a550-5eeb-403b-8ca2-c03cb3d7b672 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:24.915557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dd03a550-5eeb-403b-8ca2-c03cb3d7b672 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:24.923853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dd03a550-5eeb-403b-8ca2-c03cb3d7b672 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.087225 Feb 21 01:10:24.924429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1179/2174] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:24 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:25.757541 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-285837a0-9bcf-4de8-93b5-d563b2bd803f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:25.758806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-285837a0-9bcf-4de8-93b5-d563b2bd803f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:25.769950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-285837a0-9bcf-4de8-93b5-d563b2bd803f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:25.770706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-285837a0-9bcf-4de8-93b5-d563b2bd803f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:25.771846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-285837a0-9bcf-4de8-93b5-d563b2bd803f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:25.772419 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-285837a0-9bcf-4de8-93b5-d563b2bd803f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:25.911276 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-285837a0-9bcf-4de8-93b5-d563b2bd803f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:25.923216 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-285837a0-9bcf-4de8-93b5-d563b2bd803f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172614 Feb 21 01:10:25.923978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 996/2175] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:25 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:25.940783 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9fffa653-86c8-4106-b987-0b0319dd1557 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:25.941441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9fffa653-86c8-4106-b987-0b0319dd1557 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:25.948139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9fffa653-86c8-4106-b987-0b0319dd1557 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:25.948603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9fffa653-86c8-4106-b987-0b0319dd1557 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:25.949345 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9fffa653-86c8-4106-b987-0b0319dd1557 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:25.949763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9fffa653-86c8-4106-b987-0b0319dd1557 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:26.018429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9fffa653-86c8-4106-b987-0b0319dd1557 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:26.027164 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9fffa653-86c8-4106-b987-0b0319dd1557 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090124 Feb 21 01:10:26.027748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1180/2176] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:25 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:26.946073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e1d0f20a-f249-464d-a1b1-f3fa5e73bbf2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:26.947001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e1d0f20a-f249-464d-a1b1-f3fa5e73bbf2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:26.957747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1d0f20a-f249-464d-a1b1-f3fa5e73bbf2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:26.958488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1d0f20a-f249-464d-a1b1-f3fa5e73bbf2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:26.959827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1d0f20a-f249-464d-a1b1-f3fa5e73bbf2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:26.960588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e1d0f20a-f249-464d-a1b1-f3fa5e73bbf2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:27.043245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-56483161-ff9b-44c8-8098-404a73f3fac0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:27.043886 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-56483161-ff9b-44c8-8098-404a73f3fac0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:27.050147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56483161-ff9b-44c8-8098-404a73f3fac0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:27.050633 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56483161-ff9b-44c8-8098-404a73f3fac0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:27.051415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56483161-ff9b-44c8-8098-404a73f3fac0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:27.051844 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-56483161-ff9b-44c8-8098-404a73f3fac0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:27.111981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e1d0f20a-f249-464d-a1b1-f3fa5e73bbf2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:27.116002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-56483161-ff9b-44c8-8098-404a73f3fac0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:27.120342 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e1d0f20a-f249-464d-a1b1-f3fa5e73bbf2 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.180930 Feb 21 01:10:27.121056 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 997/2177] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:26 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:27.124189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-56483161-ff9b-44c8-8098-404a73f3fac0 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084851 Feb 21 01:10:27.124754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1181/2178] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:27 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:28.141974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1bf7003c-7dd8-49d7-94a0-be19ded77fe4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:28.142958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1bf7003c-7dd8-49d7-94a0-be19ded77fe4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:28.145069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8f4a0869-fa33-4b9e-b992-e74468049c0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:28.146234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8f4a0869-fa33-4b9e-b992-e74468049c0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:28.151132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1bf7003c-7dd8-49d7-94a0-be19ded77fe4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:28.151593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1bf7003c-7dd8-49d7-94a0-be19ded77fe4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:28.152382 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1bf7003c-7dd8-49d7-94a0-be19ded77fe4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:28.152709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f4a0869-fa33-4b9e-b992-e74468049c0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:28.152858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1bf7003c-7dd8-49d7-94a0-be19ded77fe4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:28.153142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f4a0869-fa33-4b9e-b992-e74468049c0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:28.153900 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f4a0869-fa33-4b9e-b992-e74468049c0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:28.154419 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8f4a0869-fa33-4b9e-b992-e74468049c0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:28.214039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8f4a0869-fa33-4b9e-b992-e74468049c0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:28.222203 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8f4a0869-fa33-4b9e-b992-e74468049c0f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.083684 Feb 21 01:10:28.222796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1182/2179] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:28 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:28.290348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1bf7003c-7dd8-49d7-94a0-be19ded77fe4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:28.300171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1bf7003c-7dd8-49d7-94a0-be19ded77fe4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164367 Feb 21 01:10:28.300774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 998/2180] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:28 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:29.242941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4b3f2969-6a51-4e63-98bc-c8ac7ab794a9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:29.243996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4b3f2969-6a51-4e63-98bc-c8ac7ab794a9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:29.255162 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b3f2969-6a51-4e63-98bc-c8ac7ab794a9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:29.255846 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b3f2969-6a51-4e63-98bc-c8ac7ab794a9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:29.256686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b3f2969-6a51-4e63-98bc-c8ac7ab794a9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:29.257112 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4b3f2969-6a51-4e63-98bc-c8ac7ab794a9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:29.316759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a218cce8-d3aa-4439-9b1f-3e0663776447 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:29.317464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a218cce8-d3aa-4439-9b1f-3e0663776447 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:29.324248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a218cce8-d3aa-4439-9b1f-3e0663776447 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:29.324728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a218cce8-d3aa-4439-9b1f-3e0663776447 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:29.325502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4b3f2969-6a51-4e63-98bc-c8ac7ab794a9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:29.325693 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a218cce8-d3aa-4439-9b1f-3e0663776447 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:29.325926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a218cce8-d3aa-4439-9b1f-3e0663776447 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:29.333686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4b3f2969-6a51-4e63-98bc-c8ac7ab794a9 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096950 Feb 21 01:10:29.334230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1183/2181] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:29 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:29.472344 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a218cce8-d3aa-4439-9b1f-3e0663776447 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:29.481138 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a218cce8-d3aa-4439-9b1f-3e0663776447 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168149 Feb 21 01:10:29.481736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 999/2182] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:29 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:30.354589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d9b89f86-b6b2-40d0-bde6-c92ebea437fa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:30.355726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d9b89f86-b6b2-40d0-bde6-c92ebea437fa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:30.365903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d9b89f86-b6b2-40d0-bde6-c92ebea437fa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:30.366335 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d9b89f86-b6b2-40d0-bde6-c92ebea437fa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:30.367100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d9b89f86-b6b2-40d0-bde6-c92ebea437fa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:30.367522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d9b89f86-b6b2-40d0-bde6-c92ebea437fa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:30.443157 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d9b89f86-b6b2-40d0-bde6-c92ebea437fa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:30.456030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d9b89f86-b6b2-40d0-bde6-c92ebea437fa tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.107248 Feb 21 01:10:30.456930 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1184/2183] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:30 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:30.498057 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8a339d73-f688-45bd-a1d1-ce5a8b58ce8b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:30.498665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8a339d73-f688-45bd-a1d1-ce5a8b58ce8b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:30.505310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a339d73-f688-45bd-a1d1-ce5a8b58ce8b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:30.505792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a339d73-f688-45bd-a1d1-ce5a8b58ce8b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:30.506556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a339d73-f688-45bd-a1d1-ce5a8b58ce8b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:30.506978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a339d73-f688-45bd-a1d1-ce5a8b58ce8b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:30.645936 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8a339d73-f688-45bd-a1d1-ce5a8b58ce8b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:30.657876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8a339d73-f688-45bd-a1d1-ce5a8b58ce8b tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163224 Feb 21 01:10:30.658652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1000/2184] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:30 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:31.473796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-23fb614d-2549-4cbb-b84a-7ce14adce344 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:31.474449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-23fb614d-2549-4cbb-b84a-7ce14adce344 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:31.480934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23fb614d-2549-4cbb-b84a-7ce14adce344 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.481376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23fb614d-2549-4cbb-b84a-7ce14adce344 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.482112 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23fb614d-2549-4cbb-b84a-7ce14adce344 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.482534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-23fb614d-2549-4cbb-b84a-7ce14adce344 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.541799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-23fb614d-2549-4cbb-b84a-7ce14adce344 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:31.549918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-23fb614d-2549-4cbb-b84a-7ce14adce344 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.079970 Feb 21 01:10:31.550514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1185/2185] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:31 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:31.679099 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4e29e4f8-4a1c-4efc-8483-7886959de713 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:31.680110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4e29e4f8-4a1c-4efc-8483-7886959de713 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:31.690816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4e29e4f8-4a1c-4efc-8483-7886959de713 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.691559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4e29e4f8-4a1c-4efc-8483-7886959de713 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.692905 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4e29e4f8-4a1c-4efc-8483-7886959de713 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:31.693621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4e29e4f8-4a1c-4efc-8483-7886959de713 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:31.831633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4e29e4f8-4a1c-4efc-8483-7886959de713 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:31.844645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4e29e4f8-4a1c-4efc-8483-7886959de713 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171513 Feb 21 01:10:31.845420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1001/2186] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:31 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:32.567151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-02d452d3-57f4-475a-b9fd-96bca1e3e0a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:32.567769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-02d452d3-57f4-475a-b9fd-96bca1e3e0a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:32.574710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-02d452d3-57f4-475a-b9fd-96bca1e3e0a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:32.575156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-02d452d3-57f4-475a-b9fd-96bca1e3e0a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:32.575934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-02d452d3-57f4-475a-b9fd-96bca1e3e0a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:32.576378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-02d452d3-57f4-475a-b9fd-96bca1e3e0a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:32.645809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-02d452d3-57f4-475a-b9fd-96bca1e3e0a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:32.653813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-02d452d3-57f4-475a-b9fd-96bca1e3e0a1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090535 Feb 21 01:10:32.654386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1186/2187] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:32 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:32.866302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-46ff97ff-9ab1-49de-bb41-b7847873977a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:32.867166 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-46ff97ff-9ab1-49de-bb41-b7847873977a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:32.876036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-46ff97ff-9ab1-49de-bb41-b7847873977a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:32.876597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-46ff97ff-9ab1-49de-bb41-b7847873977a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:32.877499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-46ff97ff-9ab1-49de-bb41-b7847873977a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:32.877994 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-46ff97ff-9ab1-49de-bb41-b7847873977a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.027749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-46ff97ff-9ab1-49de-bb41-b7847873977a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:33.036172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-46ff97ff-9ab1-49de-bb41-b7847873977a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176140 Feb 21 01:10:33.036781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1002/2188] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:32 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:33.672468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fe1746b0-0ff8-46e6-8ae9-adbfc56e751f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:33.673380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fe1746b0-0ff8-46e6-8ae9-adbfc56e751f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:33.682044 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe1746b0-0ff8-46e6-8ae9-adbfc56e751f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:33.682496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe1746b0-0ff8-46e6-8ae9-adbfc56e751f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.683255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe1746b0-0ff8-46e6-8ae9-adbfc56e751f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:33.683675 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fe1746b0-0ff8-46e6-8ae9-adbfc56e751f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:33.757463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fe1746b0-0ff8-46e6-8ae9-adbfc56e751f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:33.765810 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fe1746b0-0ff8-46e6-8ae9-adbfc56e751f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.098816 Feb 21 01:10:33.766447 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1187/2189] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:33 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:34.057498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1694cfde-2b01-4a1b-91fd-ace588f9c363 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:34.058496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1694cfde-2b01-4a1b-91fd-ace588f9c363 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:34.069134 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1694cfde-2b01-4a1b-91fd-ace588f9c363 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:34.069868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1694cfde-2b01-4a1b-91fd-ace588f9c363 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:34.071183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1694cfde-2b01-4a1b-91fd-ace588f9c363 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:34.071645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1694cfde-2b01-4a1b-91fd-ace588f9c363 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:34.213432 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1694cfde-2b01-4a1b-91fd-ace588f9c363 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:34.221300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1694cfde-2b01-4a1b-91fd-ace588f9c363 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.170173 Feb 21 01:10:34.221899 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1003/2190] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:34 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:34.787287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-002996d4-4139-41cb-b360-40f636d8c938 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:34.788154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-002996d4-4139-41cb-b360-40f636d8c938 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:34.795569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-002996d4-4139-41cb-b360-40f636d8c938 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:34.796015 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-002996d4-4139-41cb-b360-40f636d8c938 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:34.796824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-002996d4-4139-41cb-b360-40f636d8c938 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:34.797258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-002996d4-4139-41cb-b360-40f636d8c938 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:34.856427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-002996d4-4139-41cb-b360-40f636d8c938 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:34.864314 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-002996d4-4139-41cb-b360-40f636d8c938 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.083651 Feb 21 01:10:34.864903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1188/2191] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:34 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:35.242272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3ac3c35a-154b-4aee-960f-37972b71db43 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:35.243215 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3ac3c35a-154b-4aee-960f-37972b71db43 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:35.251114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ac3c35a-154b-4aee-960f-37972b71db43 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.251609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ac3c35a-154b-4aee-960f-37972b71db43 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.252504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ac3c35a-154b-4aee-960f-37972b71db43 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.252985 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3ac3c35a-154b-4aee-960f-37972b71db43 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.403386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3ac3c35a-154b-4aee-960f-37972b71db43 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:35.416368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3ac3c35a-154b-4aee-960f-37972b71db43 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.180113 Feb 21 01:10:35.417001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1004/2192] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:35 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:35.884831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-cb7c05f8-aebc-4c8e-bfd5-f68f2f310b23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:35.885649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-cb7c05f8-aebc-4c8e-bfd5-f68f2f310b23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:35.893833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb7c05f8-aebc-4c8e-bfd5-f68f2f310b23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.894738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb7c05f8-aebc-4c8e-bfd5-f68f2f310b23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.895737 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb7c05f8-aebc-4c8e-bfd5-f68f2f310b23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:35.896270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-cb7c05f8-aebc-4c8e-bfd5-f68f2f310b23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:35.958796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-cb7c05f8-aebc-4c8e-bfd5-f68f2f310b23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:35.966794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-cb7c05f8-aebc-4c8e-bfd5-f68f2f310b23 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088457 Feb 21 01:10:35.967360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1189/2193] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:35 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:36.437543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7aadc2b4-561d-4756-9cc7-279d8fd8fb33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:36.438550 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7aadc2b4-561d-4756-9cc7-279d8fd8fb33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:36.449353 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7aadc2b4-561d-4756-9cc7-279d8fd8fb33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.450088 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7aadc2b4-561d-4756-9cc7-279d8fd8fb33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.451386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7aadc2b4-561d-4756-9cc7-279d8fd8fb33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.452104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7aadc2b4-561d-4756-9cc7-279d8fd8fb33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.601788 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7aadc2b4-561d-4756-9cc7-279d8fd8fb33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:36.609827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7aadc2b4-561d-4756-9cc7-279d8fd8fb33 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.178706 Feb 21 01:10:36.610409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1005/2194] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:36 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:36.988564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b5bf8372-9907-436c-90dd-ac96df7e162a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:36.989607 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b5bf8372-9907-436c-90dd-ac96df7e162a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:36.997476 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5bf8372-9907-436c-90dd-ac96df7e162a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.997932 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5bf8372-9907-436c-90dd-ac96df7e162a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:36.998695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5bf8372-9907-436c-90dd-ac96df7e162a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:36.999123 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b5bf8372-9907-436c-90dd-ac96df7e162a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:37.063824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b5bf8372-9907-436c-90dd-ac96df7e162a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:37.072264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b5bf8372-9907-436c-90dd-ac96df7e162a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090798 Feb 21 01:10:37.072923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1190/2195] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:36 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:37.627102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-470303db-2f7c-4a51-b6ca-c9c34f956444 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:37.627722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-470303db-2f7c-4a51-b6ca-c9c34f956444 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:37.634597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-470303db-2f7c-4a51-b6ca-c9c34f956444 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:37.635141 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-470303db-2f7c-4a51-b6ca-c9c34f956444 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:37.635915 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-470303db-2f7c-4a51-b6ca-c9c34f956444 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:37.636346 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-470303db-2f7c-4a51-b6ca-c9c34f956444 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:37.782146 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-470303db-2f7c-4a51-b6ca-c9c34f956444 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:37.793569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-470303db-2f7c-4a51-b6ca-c9c34f956444 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169989 Feb 21 01:10:37.794391 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1006/2196] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:37 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:38.091621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d4c53342-b676-4588-a55d-42a585717b11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:38.092206 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d4c53342-b676-4588-a55d-42a585717b11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:38.098889 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4c53342-b676-4588-a55d-42a585717b11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:38.099322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4c53342-b676-4588-a55d-42a585717b11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:38.100092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4c53342-b676-4588-a55d-42a585717b11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:38.100547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4c53342-b676-4588-a55d-42a585717b11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:38.159676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d4c53342-b676-4588-a55d-42a585717b11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:38.167666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d4c53342-b676-4588-a55d-42a585717b11 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.080396 Feb 21 01:10:38.168245 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1191/2197] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:38 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:38.819659 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c1662bf3-588d-490e-8552-40833e3647b9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:38.820605 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c1662bf3-588d-490e-8552-40833e3647b9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:38.831190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1662bf3-588d-490e-8552-40833e3647b9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:38.831921 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1662bf3-588d-490e-8552-40833e3647b9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:38.833263 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1662bf3-588d-490e-8552-40833e3647b9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:38.833972 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c1662bf3-588d-490e-8552-40833e3647b9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:38.974609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c1662bf3-588d-490e-8552-40833e3647b9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:38.984371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c1662bf3-588d-490e-8552-40833e3647b9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171097 Feb 21 01:10:38.984992 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1007/2198] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:38 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:39.188276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ab598454-fbce-4914-b823-e995b4cbf879 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:39.189261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ab598454-fbce-4914-b823-e995b4cbf879 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:39.199013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ab598454-fbce-4914-b823-e995b4cbf879 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.199455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ab598454-fbce-4914-b823-e995b4cbf879 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.200258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ab598454-fbce-4914-b823-e995b4cbf879 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:39.200689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ab598454-fbce-4914-b823-e995b4cbf879 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:39.265826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ab598454-fbce-4914-b823-e995b4cbf879 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:39.274725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ab598454-fbce-4914-b823-e995b4cbf879 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092666 Feb 21 01:10:39.275336 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1192/2199] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:39 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:40.009602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a3f115c4-fe0c-4219-8f32-035ac7398754 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:40.010578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a3f115c4-fe0c-4219-8f32-035ac7398754 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:40.021731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3f115c4-fe0c-4219-8f32-035ac7398754 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:40.022467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3f115c4-fe0c-4219-8f32-035ac7398754 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:40.023736 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3f115c4-fe0c-4219-8f32-035ac7398754 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:40.024454 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a3f115c4-fe0c-4219-8f32-035ac7398754 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:40.182116 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a3f115c4-fe0c-4219-8f32-035ac7398754 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:40.192208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a3f115c4-fe0c-4219-8f32-035ac7398754 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.188689 Feb 21 01:10:40.193208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1008/2200] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:40 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:40.295980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d0dec7a4-18a4-4b23-9114-11a2f1936990 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:40.296906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d0dec7a4-18a4-4b23-9114-11a2f1936990 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:40.307294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d0dec7a4-18a4-4b23-9114-11a2f1936990 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:40.307739 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d0dec7a4-18a4-4b23-9114-11a2f1936990 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:40.308648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d0dec7a4-18a4-4b23-9114-11a2f1936990 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:40.309095 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d0dec7a4-18a4-4b23-9114-11a2f1936990 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:40.369813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d0dec7a4-18a4-4b23-9114-11a2f1936990 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:40.382964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d0dec7a4-18a4-4b23-9114-11a2f1936990 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.092985 Feb 21 01:10:40.383852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1193/2201] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:40 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:41.216260 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-227b6f7d-3539-4d60-a1b7-48dc74cdc35d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:41.217171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-227b6f7d-3539-4d60-a1b7-48dc74cdc35d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:41.227540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-227b6f7d-3539-4d60-a1b7-48dc74cdc35d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:41.228193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-227b6f7d-3539-4d60-a1b7-48dc74cdc35d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.229471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-227b6f7d-3539-4d60-a1b7-48dc74cdc35d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:41.230115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-227b6f7d-3539-4d60-a1b7-48dc74cdc35d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.383436 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-227b6f7d-3539-4d60-a1b7-48dc74cdc35d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:41.391598 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-227b6f7d-3539-4d60-a1b7-48dc74cdc35d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.180470 Feb 21 01:10:41.392196 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1009/2202] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:41 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:41.401201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a04cdcac-ef8c-411d-be92-1154d3e24f71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:41.401749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a04cdcac-ef8c-411d-be92-1154d3e24f71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:41.408423 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a04cdcac-ef8c-411d-be92-1154d3e24f71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:41.408928 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a04cdcac-ef8c-411d-be92-1154d3e24f71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.409695 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a04cdcac-ef8c-411d-be92-1154d3e24f71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:41.410121 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a04cdcac-ef8c-411d-be92-1154d3e24f71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:41.475869 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a04cdcac-ef8c-411d-be92-1154d3e24f71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:41.483751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a04cdcac-ef8c-411d-be92-1154d3e24f71 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086293 Feb 21 01:10:41.484297 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1194/2203] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:41 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:42.413204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2292c454-6e08-4640-9f99-5ea06fa3fff8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:42.414188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2292c454-6e08-4640-9f99-5ea06fa3fff8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:42.422272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2292c454-6e08-4640-9f99-5ea06fa3fff8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.422723 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2292c454-6e08-4640-9f99-5ea06fa3fff8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.423502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2292c454-6e08-4640-9f99-5ea06fa3fff8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.423938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2292c454-6e08-4640-9f99-5ea06fa3fff8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.503049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-071818c5-1a06-4cb9-a5d8-d25a7fe4fad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:42.503719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-071818c5-1a06-4cb9-a5d8-d25a7fe4fad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:42.510384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-071818c5-1a06-4cb9-a5d8-d25a7fe4fad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.510829 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-071818c5-1a06-4cb9-a5d8-d25a7fe4fad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.511661 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-071818c5-1a06-4cb9-a5d8-d25a7fe4fad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:42.512087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-071818c5-1a06-4cb9-a5d8-d25a7fe4fad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:42.566746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2292c454-6e08-4640-9f99-5ea06fa3fff8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:42.573315 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-071818c5-1a06-4cb9-a5d8-d25a7fe4fad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:42.575390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2292c454-6e08-4640-9f99-5ea06fa3fff8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168470 Feb 21 01:10:42.575979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1010/2204] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:42 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:42.581548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-071818c5-1a06-4cb9-a5d8-d25a7fe4fad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.082223 Feb 21 01:10:42.582117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1195/2205] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:42 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:43.595592 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-84545460-d56a-4116-a4c1-0ed1c4c57e4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:43.596618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-84545460-d56a-4116-a4c1-0ed1c4c57e4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:43.598577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8b357656-be03-469e-810e-d750fdd3fc80 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:43.599262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8b357656-be03-469e-810e-d750fdd3fc80 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:43.603701 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84545460-d56a-4116-a4c1-0ed1c4c57e4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:43.604155 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84545460-d56a-4116-a4c1-0ed1c4c57e4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:43.604976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84545460-d56a-4116-a4c1-0ed1c4c57e4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:43.605405 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-84545460-d56a-4116-a4c1-0ed1c4c57e4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:43.605568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b357656-be03-469e-810e-d750fdd3fc80 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:43.606026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b357656-be03-469e-810e-d750fdd3fc80 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:43.606787 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b357656-be03-469e-810e-d750fdd3fc80 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:43.607212 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b357656-be03-469e-810e-d750fdd3fc80 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:43.667255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8b357656-be03-469e-810e-d750fdd3fc80 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:43.675627 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8b357656-be03-469e-810e-d750fdd3fc80 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.080761 Feb 21 01:10:43.676201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1196/2206] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:43 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:43.741498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-84545460-d56a-4116-a4c1-0ed1c4c57e4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:43.754066 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-84545460-d56a-4116-a4c1-0ed1c4c57e4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164734 Feb 21 01:10:43.754862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1011/2207] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:43 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:44.692658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d4df111e-d074-45ec-a9b5-a0c91832d90e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:44.693224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d4df111e-d074-45ec-a9b5-a0c91832d90e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:44.700019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4df111e-d074-45ec-a9b5-a0c91832d90e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.700481 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4df111e-d074-45ec-a9b5-a0c91832d90e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.701258 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4df111e-d074-45ec-a9b5-a0c91832d90e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.701680 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4df111e-d074-45ec-a9b5-a0c91832d90e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.764463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d4df111e-d074-45ec-a9b5-a0c91832d90e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:44.775611 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d4df111e-d074-45ec-a9b5-a0c91832d90e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086422 Feb 21 01:10:44.776411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1197/2208] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:44 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:44.776633 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-96b28c8b-cf84-4e78-9d54-e3757d603c60 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:44.777385 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-96b28c8b-cf84-4e78-9d54-e3757d603c60 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:44.787259 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b28c8b-cf84-4e78-9d54-e3757d603c60 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.787644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b28c8b-cf84-4e78-9d54-e3757d603c60 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.788726 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b28c8b-cf84-4e78-9d54-e3757d603c60 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:44.789349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-96b28c8b-cf84-4e78-9d54-e3757d603c60 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:44.926621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-96b28c8b-cf84-4e78-9d54-e3757d603c60 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:44.935086 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-96b28c8b-cf84-4e78-9d54-e3757d603c60 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.163964 Feb 21 01:10:44.935650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1012/2209] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:44 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:45.800850 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d26991e4-a03c-4994-8f06-9893a3f379b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:45.801667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d26991e4-a03c-4994-8f06-9893a3f379b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:45.811281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d26991e4-a03c-4994-8f06-9893a3f379b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.811725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d26991e4-a03c-4994-8f06-9893a3f379b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.812517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d26991e4-a03c-4994-8f06-9893a3f379b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.812943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d26991e4-a03c-4994-8f06-9893a3f379b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.886253 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d26991e4-a03c-4994-8f06-9893a3f379b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:45.894833 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d26991e4-a03c-4994-8f06-9893a3f379b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.099994 Feb 21 01:10:45.895410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1198/2210] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:45 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:45.955873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dbb67b53-835f-464b-9817-a0992a92ff1f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:45.956989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dbb67b53-835f-464b-9817-a0992a92ff1f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:45.967371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbb67b53-835f-464b-9817-a0992a92ff1f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.968094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbb67b53-835f-464b-9817-a0992a92ff1f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:45.969417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbb67b53-835f-464b-9817-a0992a92ff1f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:45.970125 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbb67b53-835f-464b-9817-a0992a92ff1f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:46.119688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dbb67b53-835f-464b-9817-a0992a92ff1f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:46.127958 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dbb67b53-835f-464b-9817-a0992a92ff1f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.178322 Feb 21 01:10:46.128558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1013/2211] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:45 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:46.912254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-80e023de-da43-44e5-8b04-c666b295bf1c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:46.912912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-80e023de-da43-44e5-8b04-c666b295bf1c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:46.920356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80e023de-da43-44e5-8b04-c666b295bf1c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:46.920879 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80e023de-da43-44e5-8b04-c666b295bf1c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:46.921725 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80e023de-da43-44e5-8b04-c666b295bf1c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:46.922196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-80e023de-da43-44e5-8b04-c666b295bf1c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:46.990842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-80e023de-da43-44e5-8b04-c666b295bf1c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:46.999187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-80e023de-da43-44e5-8b04-c666b295bf1c tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091228 Feb 21 01:10:46.999776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1199/2212] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:46 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:47.149399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-15afb919-5287-4525-b06a-18bb8fe8c8af tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:47.150411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-15afb919-5287-4525-b06a-18bb8fe8c8af tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:47.160950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15afb919-5287-4525-b06a-18bb8fe8c8af tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.161688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15afb919-5287-4525-b06a-18bb8fe8c8af tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.163079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15afb919-5287-4525-b06a-18bb8fe8c8af tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.163695 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-15afb919-5287-4525-b06a-18bb8fe8c8af tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.314074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-15afb919-5287-4525-b06a-18bb8fe8c8af tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:47.322602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-15afb919-5287-4525-b06a-18bb8fe8c8af tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.179774 Feb 21 01:10:47.323170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1014/2213] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:47 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:47.642039 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a44bff67-b67f-495e-b93d-adc499ac2f2b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:47.642587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a44bff67-b67f-495e-b93d-adc499ac2f2b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:47.650062 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a44bff67-b67f-495e-b93d-adc499ac2f2b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.650534 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a44bff67-b67f-495e-b93d-adc499ac2f2b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.651382 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a44bff67-b67f-495e-b93d-adc499ac2f2b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.651848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a44bff67-b67f-495e-b93d-adc499ac2f2b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.678270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a44bff67-b67f-495e-b93d-adc499ac2f2b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Going to try to terminate instance {{(pid=123098) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:10:47.759789 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a44bff67-b67f-495e-b93d-adc499ac2f2b tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 204 len: 0 microversion: 2.20 time: 0.121608 Feb 21 01:10:47.760366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1200/2214] 10.222.0.72 () {60 vars in 1279 bytes} [Mon Feb 21 01:10:47 2022] DELETE /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:10:47.768604 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:47.769604 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:47.775430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.775872 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.776735 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:47.777105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:47.919745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:47.927933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:47.929438 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:47.930598 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-059e991c-7817-4d8b-8c07-40c92d7155cf tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1722 microversion: 2.20 time: 0.165767 Feb 21 01:10:47.931143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1015/2215] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:47 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:48.020455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9d9207cc-1764-4774-863c-53686b712e94 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:48.021646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9d9207cc-1764-4774-863c-53686b712e94 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:48.032262 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d9207cc-1764-4774-863c-53686b712e94 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.032958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d9207cc-1764-4774-863c-53686b712e94 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.034280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d9207cc-1764-4774-863c-53686b712e94 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.034996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d9207cc-1764-4774-863c-53686b712e94 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.101749 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9d9207cc-1764-4774-863c-53686b712e94 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:48.109959 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9d9207cc-1764-4774-863c-53686b712e94 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096812 Feb 21 01:10:48.110537 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1201/2216] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:48 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:48.342911 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-100e8bf4-266c-49aa-96fc-eedd74204a41 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:48.343509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-100e8bf4-266c-49aa-96fc-eedd74204a41 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:48.350817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-100e8bf4-266c-49aa-96fc-eedd74204a41 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.351301 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-100e8bf4-266c-49aa-96fc-eedd74204a41 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.352188 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-100e8bf4-266c-49aa-96fc-eedd74204a41 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.352707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-100e8bf4-266c-49aa-96fc-eedd74204a41 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.761680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-100e8bf4-266c-49aa-96fc-eedd74204a41 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:48.770976 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-100e8bf4-266c-49aa-96fc-eedd74204a41 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.434165 Feb 21 01:10:48.771543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1016/2217] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:48 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:48.952264 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:48.953330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:48.963820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.964643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:48.965942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:48.966658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.117017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.125452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.126887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8dd3e6bf-a3c4-435d-8916-6ba7de29b787 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:49.127488 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8dd3e6bf-a3c4-435d-8916-6ba7de29b787 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:49.127646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.128766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a1c2470b-f595-4e18-9f72-5fba06a69dd9 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1722 microversion: 2.20 time: 0.182716 Feb 21 01:10:49.129527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1202/2218] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:48 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:10:49.133898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd3e6bf-a3c4-435d-8916-6ba7de29b787 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:49.134335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd3e6bf-a3c4-435d-8916-6ba7de29b787 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.135108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd3e6bf-a3c4-435d-8916-6ba7de29b787 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:49.135526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd3e6bf-a3c4-435d-8916-6ba7de29b787 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.196185 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8dd3e6bf-a3c4-435d-8916-6ba7de29b787 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.209325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8dd3e6bf-a3c4-435d-8916-6ba7de29b787 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085829 Feb 21 01:10:49.210194 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1017/2219] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:49 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:49.788194 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-05c5dd3d-507a-4b24-af5e-b30d8f8f3374 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:49.788751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-05c5dd3d-507a-4b24-af5e-b30d8f8f3374 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:49.795160 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05c5dd3d-507a-4b24-af5e-b30d8f8f3374 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:49.795578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05c5dd3d-507a-4b24-af5e-b30d8f8f3374 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.796380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05c5dd3d-507a-4b24-af5e-b30d8f8f3374 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:49.796840 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05c5dd3d-507a-4b24-af5e-b30d8f8f3374 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:49.935094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-05c5dd3d-507a-4b24-af5e-b30d8f8f3374 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:49.943150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-05c5dd3d-507a-4b24-af5e-b30d8f8f3374 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158788 Feb 21 01:10:49.943770 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1203/2220] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:49 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:50.147441 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:50.148038 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:50.154991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.155445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.156225 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.156692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.227275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:50.227949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4d879256-cf19-4747-ba6a-520750ae3650 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:50.228791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4d879256-cf19-4747-ba6a-520750ae3650 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:50.235548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d879256-cf19-4747-ba6a-520750ae3650 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.236256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d879256-cf19-4747-ba6a-520750ae3650 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.237114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d879256-cf19-4747-ba6a-520750ae3650 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.237510 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4d879256-cf19-4747-ba6a-520750ae3650 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.240318 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:50.241907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d9176fb26604a1190825afedf8823cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06103339bc54d0f93b531034454d6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:50.243087 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0df829f7-623e-464b-85b3-bedb7670f439 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 200 len: 1655 microversion: 2.20 time: 0.099859 Feb 21 01:10:50.243855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1018/2221] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:50 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 1655 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:10:50.298076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4d879256-cf19-4747-ba6a-520750ae3650 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:50.305992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4d879256-cf19-4747-ba6a-520750ae3650 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081660 Feb 21 01:10:50.306588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1204/2222] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:50 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:50.395397 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-af4c28be-a8d1-4a7c-8cb8-3076d28fbd1a req-49e5d05f-9730-490d-8c67-a0df70edb899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7778906-67a3-420a-b203-13e1eb3812fb", "name": "network-vif-deleted", "tag": "8700ee42-a07a-4134-b47a-50fd73f95601"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:10:50.397011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:10:50.397011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:10:50.404272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-af4c28be-a8d1-4a7c-8cb8-3076d28fbd1a req-49e5d05f-9730-490d-8c67-a0df70edb899 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.404747 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-af4c28be-a8d1-4a7c-8cb8-3076d28fbd1a req-49e5d05f-9730-490d-8c67-a0df70edb899 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.420593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-af4c28be-a8d1-4a7c-8cb8-3076d28fbd1a req-49e5d05f-9730-490d-8c67-a0df70edb899 service nova] Creating event network-vif-deleted:8700ee42-a07a-4134-b47a-50fd73f95601 for instance b7778906-67a3-420a-b203-13e1eb3812fb on hv-cinder-81322 Feb 21 01:10:50.426367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-af4c28be-a8d1-4a7c-8cb8-3076d28fbd1a req-49e5d05f-9730-490d-8c67-a0df70edb899 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034929 Feb 21 01:10:50.426978 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1019/2223] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:10:50.961255 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e66db547-1549-4822-9d8f-4986c2734466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:50.961998 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e66db547-1549-4822-9d8f-4986c2734466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:50.969047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e66db547-1549-4822-9d8f-4986c2734466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.969496 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e66db547-1549-4822-9d8f-4986c2734466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:50.970294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e66db547-1549-4822-9d8f-4986c2734466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:50.970718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e66db547-1549-4822-9d8f-4986c2734466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.110279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e66db547-1549-4822-9d8f-4986c2734466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:51.118230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e66db547-1549-4822-9d8f-4986c2734466 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.161422 Feb 21 01:10:51.118779 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1205/2224] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:50 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:51.262669 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:51.263365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:51.271759 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.272564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.274060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.274951 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.292081 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] HTTP exception thrown: Instance b7778906-67a3-420a-b203-13e1eb3812fb could not be found. Feb 21 01:10:51.292856 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Returning 404 to user: Instance b7778906-67a3-420a-b203-13e1eb3812fb could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:10:51.293741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-194c2640-8ce5-45ff-b3f4-5343819702e8 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 404 len: 111 microversion: 2.20 time: 0.035917 Feb 21 01:10:51.294324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1020/2225] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:51 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:10:51.303054 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6d861b3b-af1d-4a04-9976-5434d496b306 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '.version_select at 0x7fe571f45160>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:51.323153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8dd556ae-1401-4ddb-83e8-0a222751074a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:51.323797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8dd556ae-1401-4ddb-83e8-0a222751074a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:51.327625 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6d861b3b-af1d-4a04-9976-5434d496b306 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-860944921" status: 204 len: 0 microversion: 2.20 time: 0.028259 Feb 21 01:10:51.328792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1206/2226] 10.222.0.72 () {60 vars in 1258 bytes} [Mon Feb 21 01:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-860944921 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 21 01:10:51.330620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd556ae-1401-4ddb-83e8-0a222751074a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.331080 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd556ae-1401-4ddb-83e8-0a222751074a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.331929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd556ae-1401-4ddb-83e8-0a222751074a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:51.332909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8dd556ae-1401-4ddb-83e8-0a222751074a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:51.407232 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8dd556ae-1401-4ddb-83e8-0a222751074a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:51.415468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8dd556ae-1401-4ddb-83e8-0a222751074a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096168 Feb 21 01:10:51.416693 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1021/2227] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:51 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:51.991541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:51.992193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:52.000651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.001122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.001883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.002306 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.015651 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] HTTP exception thrown: Instance b7778906-67a3-420a-b203-13e1eb3812fb could not be found. Feb 21 01:10:52.016225 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Returning 404 to user: Instance b7778906-67a3-420a-b203-13e1eb3812fb could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:10:52.017220 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0da72a45-fb90-481d-af2a-275ce379b1d2 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 404 len: 111 microversion: 2.20 time: 0.030527 Feb 21 01:10:52.017735 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1207/2228] 10.222.0.72 () {60 vars in 1279 bytes} [Mon Feb 21 01:10:51 2022] DELETE /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 21 01:10:52.026145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:52.026749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: b7778906-67a3-420a-b203-13e1eb3812fb] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:52.033243 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.033685 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.034450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.034876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.048355 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] HTTP exception thrown: Instance b7778906-67a3-420a-b203-13e1eb3812fb could not be found. Feb 21 01:10:52.048960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Returning 404 to user: Instance b7778906-67a3-420a-b203-13e1eb3812fb could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:10:52.049817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0b363783-f383-4277-af8f-3056502788ed tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb" status: 404 len: 111 microversion: 2.20 time: 0.027488 Feb 21 01:10:52.050335 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1022/2229] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:10:52 2022] GET /compute/v2.1/servers/b7778906-67a3-420a-b203-13e1eb3812fb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:10:52.138171 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2d07833f-b78c-4ffd-94d9-1b403dbba1b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:52.139175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2d07833f-b78c-4ffd-94d9-1b403dbba1b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:52.149910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d07833f-b78c-4ffd-94d9-1b403dbba1b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.150650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d07833f-b78c-4ffd-94d9-1b403dbba1b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.151926 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d07833f-b78c-4ffd-94d9-1b403dbba1b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.152710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d07833f-b78c-4ffd-94d9-1b403dbba1b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.297658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2d07833f-b78c-4ffd-94d9-1b403dbba1b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:52.306031 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2d07833f-b78c-4ffd-94d9-1b403dbba1b5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.174136 Feb 21 01:10:52.306632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1208/2230] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:52 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:52.437973 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-94004060-77b3-41dc-9d87-50a271eb007a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:52.438981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-94004060-77b3-41dc-9d87-50a271eb007a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:52.449831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-94004060-77b3-41dc-9d87-50a271eb007a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.450567 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-94004060-77b3-41dc-9d87-50a271eb007a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.451933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-94004060-77b3-41dc-9d87-50a271eb007a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:52.452358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-94004060-77b3-41dc-9d87-50a271eb007a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:52.529287 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-94004060-77b3-41dc-9d87-50a271eb007a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:52.542584 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-94004060-77b3-41dc-9d87-50a271eb007a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.110755 Feb 21 01:10:52.543472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1023/2231] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:52 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:53.325944 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-05d6f6c0-779d-455c-93a7-a081c78df329 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:53.326897 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-05d6f6c0-779d-455c-93a7-a081c78df329 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:53.333621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05d6f6c0-779d-455c-93a7-a081c78df329 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:53.334060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05d6f6c0-779d-455c-93a7-a081c78df329 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:53.334820 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05d6f6c0-779d-455c-93a7-a081c78df329 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:53.335250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05d6f6c0-779d-455c-93a7-a081c78df329 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:53.480469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-05d6f6c0-779d-455c-93a7-a081c78df329 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:53.492099 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-05d6f6c0-779d-455c-93a7-a081c78df329 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171642 Feb 21 01:10:53.492937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1209/2232] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:53 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:53.562502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a0ef0c0a-512e-4500-b47d-d089d65ebc4e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:53.563100 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a0ef0c0a-512e-4500-b47d-d089d65ebc4e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:53.569816 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0ef0c0a-512e-4500-b47d-d089d65ebc4e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:53.570305 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0ef0c0a-512e-4500-b47d-d089d65ebc4e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:53.571094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0ef0c0a-512e-4500-b47d-d089d65ebc4e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:53.571527 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a0ef0c0a-512e-4500-b47d-d089d65ebc4e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:53.635332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a0ef0c0a-512e-4500-b47d-d089d65ebc4e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:53.643477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a0ef0c0a-512e-4500-b47d-d089d65ebc4e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086377 Feb 21 01:10:53.644376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1024/2233] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:53 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:54.515294 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e4b27663-9fdd-44ad-8aa4-94285e79f60c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:54.516365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e4b27663-9fdd-44ad-8aa4-94285e79f60c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:54.525195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4b27663-9fdd-44ad-8aa4-94285e79f60c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:54.525638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4b27663-9fdd-44ad-8aa4-94285e79f60c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.526637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4b27663-9fdd-44ad-8aa4-94285e79f60c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:54.526831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4b27663-9fdd-44ad-8aa4-94285e79f60c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.664152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dabdd14e-b622-4c66-95eb-37667e215bb2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:54.664703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e4b27663-9fdd-44ad-8aa4-94285e79f60c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:54.664854 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dabdd14e-b622-4c66-95eb-37667e215bb2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:54.674681 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e4b27663-9fdd-44ad-8aa4-94285e79f60c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165826 Feb 21 01:10:54.674914 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dabdd14e-b622-4c66-95eb-37667e215bb2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:54.675477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1210/2234] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:54 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:54.675614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dabdd14e-b622-4c66-95eb-37667e215bb2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.676198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dabdd14e-b622-4c66-95eb-37667e215bb2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:54.676660 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dabdd14e-b622-4c66-95eb-37667e215bb2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:54.760571 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dabdd14e-b622-4c66-95eb-37667e215bb2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:54.771369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dabdd14e-b622-4c66-95eb-37667e215bb2 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.113183 Feb 21 01:10:54.771862 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1025/2235] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:54 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:10:55.697094 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e80514b4-9e92-4e29-b9f3-a1ebb10a6a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:55.698117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e80514b4-9e92-4e29-b9f3-a1ebb10a6a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:55.708883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e80514b4-9e92-4e29-b9f3-a1ebb10a6a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.709614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e80514b4-9e92-4e29-b9f3-a1ebb10a6a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.710873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e80514b4-9e92-4e29-b9f3-a1ebb10a6a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.711582 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e80514b4-9e92-4e29-b9f3-a1ebb10a6a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.793376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b0c3efe2-b05a-4d4b-9fee-95cbec706c79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:55.793927 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b0c3efe2-b05a-4d4b-9fee-95cbec706c79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:55.800758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b0c3efe2-b05a-4d4b-9fee-95cbec706c79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.801195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b0c3efe2-b05a-4d4b-9fee-95cbec706c79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.801979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b0c3efe2-b05a-4d4b-9fee-95cbec706c79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:55.802403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b0c3efe2-b05a-4d4b-9fee-95cbec706c79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:55.851811 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e80514b4-9e92-4e29-b9f3-a1ebb10a6a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:55.859894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e80514b4-9e92-4e29-b9f3-a1ebb10a6a4c tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.169091 Feb 21 01:10:55.860514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1211/2236] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:55 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:55.861739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b0c3efe2-b05a-4d4b-9fee-95cbec706c79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:55.869746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b0c3efe2-b05a-4d4b-9fee-95cbec706c79 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.080248 Feb 21 01:10:55.870294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1026/2237] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:55 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:56.880583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b77868a3-789b-4eb0-9f41-b27335c86b6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:56.881451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b77868a3-789b-4eb0-9f41-b27335c86b6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:56.890195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9951e38e-3353-40df-8571-6acd70ebc2fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:56.890832 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9951e38e-3353-40df-8571-6acd70ebc2fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:56.891433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b77868a3-789b-4eb0-9f41-b27335c86b6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.891874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b77868a3-789b-4eb0-9f41-b27335c86b6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.892687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b77868a3-789b-4eb0-9f41-b27335c86b6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.893106 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b77868a3-789b-4eb0-9f41-b27335c86b6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.897764 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9951e38e-3353-40df-8571-6acd70ebc2fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.898201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9951e38e-3353-40df-8571-6acd70ebc2fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.899006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9951e38e-3353-40df-8571-6acd70ebc2fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:56.899429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9951e38e-3353-40df-8571-6acd70ebc2fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:56.959193 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9951e38e-3353-40df-8571-6acd70ebc2fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:56.967383 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9951e38e-3353-40df-8571-6acd70ebc2fc tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.083383 Feb 21 01:10:56.968000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1027/2238] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:56 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:57.031075 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b77868a3-789b-4eb0-9f41-b27335c86b6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:57.039353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b77868a3-789b-4eb0-9f41-b27335c86b6f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165131 Feb 21 01:10:57.039891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1212/2239] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:56 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:57.988883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-50692a86-90e4-413c-ae82-b65434ed64e3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:57.989902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-50692a86-90e4-413c-ae82-b65434ed64e3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:58.000339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-50692a86-90e4-413c-ae82-b65434ed64e3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.000815 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-50692a86-90e4-413c-ae82-b65434ed64e3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.001599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-50692a86-90e4-413c-ae82-b65434ed64e3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.002020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-50692a86-90e4-413c-ae82-b65434ed64e3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.057653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-86ba2e33-8cae-46ca-b10f-db193be37f31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:58.058371 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-86ba2e33-8cae-46ca-b10f-db193be37f31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:58.065117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86ba2e33-8cae-46ca-b10f-db193be37f31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.065547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86ba2e33-8cae-46ca-b10f-db193be37f31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.066353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86ba2e33-8cae-46ca-b10f-db193be37f31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:58.066790 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-86ba2e33-8cae-46ca-b10f-db193be37f31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:58.070686 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-50692a86-90e4-413c-ae82-b65434ed64e3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:58.079022 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-50692a86-90e4-413c-ae82-b65434ed64e3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096631 Feb 21 01:10:58.079591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1028/2240] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:57 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:58.203683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-86ba2e33-8cae-46ca-b10f-db193be37f31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:58.216108 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-86ba2e33-8cae-46ca-b10f-db193be37f31 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.162185 Feb 21 01:10:58.216979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1213/2241] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:58 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:59.100036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0c22d9fa-47e8-40fb-9069-4916eb3880fe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:59.101111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0c22d9fa-47e8-40fb-9069-4916eb3880fe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:59.110784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c22d9fa-47e8-40fb-9069-4916eb3880fe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:59.111229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c22d9fa-47e8-40fb-9069-4916eb3880fe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:59.111999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c22d9fa-47e8-40fb-9069-4916eb3880fe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:59.112430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0c22d9fa-47e8-40fb-9069-4916eb3880fe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:59.186910 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0c22d9fa-47e8-40fb-9069-4916eb3880fe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:59.199971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0c22d9fa-47e8-40fb-9069-4916eb3880fe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.105942 Feb 21 01:10:59.200940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1029/2242] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:59 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:10:59.234522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-eef60aa7-ad20-415d-99f1-68fc7ec98af4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:10:59.235076 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-eef60aa7-ad20-415d-99f1-68fc7ec98af4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:10:59.243849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eef60aa7-ad20-415d-99f1-68fc7ec98af4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:59.244471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eef60aa7-ad20-415d-99f1-68fc7ec98af4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:59.245571 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eef60aa7-ad20-415d-99f1-68fc7ec98af4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:10:59.246051 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-eef60aa7-ad20-415d-99f1-68fc7ec98af4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:10:59.395201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-eef60aa7-ad20-415d-99f1-68fc7ec98af4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:10:59.403118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-eef60aa7-ad20-415d-99f1-68fc7ec98af4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172402 Feb 21 01:10:59.403690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1214/2243] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:10:59 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:00.222840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b4a10032-768a-49b1-907b-abd5384123dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:00.224045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b4a10032-768a-49b1-907b-abd5384123dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:00.232418 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4a10032-768a-49b1-907b-abd5384123dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:00.232903 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4a10032-768a-49b1-907b-abd5384123dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:00.233707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4a10032-768a-49b1-907b-abd5384123dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:00.234131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4a10032-768a-49b1-907b-abd5384123dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:00.295136 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b4a10032-768a-49b1-907b-abd5384123dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:00.303431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b4a10032-768a-49b1-907b-abd5384123dd tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.087053 Feb 21 01:11:00.303989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1030/2244] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:00 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:00.423317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2ee7704e-981e-41ba-9a98-c5dea56317d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:00.424350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2ee7704e-981e-41ba-9a98-c5dea56317d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:00.434913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ee7704e-981e-41ba-9a98-c5dea56317d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:00.435642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ee7704e-981e-41ba-9a98-c5dea56317d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:00.436940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ee7704e-981e-41ba-9a98-c5dea56317d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:00.437653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2ee7704e-981e-41ba-9a98-c5dea56317d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:00.582150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2ee7704e-981e-41ba-9a98-c5dea56317d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:00.595832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2ee7704e-981e-41ba-9a98-c5dea56317d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.178338 Feb 21 01:11:00.596765 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1215/2245] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:00 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:01.320702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8a866488-b12a-4b94-8cb9-78c01473dad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:01.321303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8a866488-b12a-4b94-8cb9-78c01473dad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:01.328243 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a866488-b12a-4b94-8cb9-78c01473dad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.328712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a866488-b12a-4b94-8cb9-78c01473dad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.329587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a866488-b12a-4b94-8cb9-78c01473dad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.330012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8a866488-b12a-4b94-8cb9-78c01473dad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.391068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8a866488-b12a-4b94-8cb9-78c01473dad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:01.399990 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8a866488-b12a-4b94-8cb9-78c01473dad4 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.083272 Feb 21 01:11:01.400593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1031/2246] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:01 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:01.622467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-04b7c0eb-19c6-4712-ae18-f68db3e8a9ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:01.623415 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-04b7c0eb-19c6-4712-ae18-f68db3e8a9ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:01.631279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04b7c0eb-19c6-4712-ae18-f68db3e8a9ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.631723 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04b7c0eb-19c6-4712-ae18-f68db3e8a9ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.632530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04b7c0eb-19c6-4712-ae18-f68db3e8a9ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:01.632967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-04b7c0eb-19c6-4712-ae18-f68db3e8a9ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:01.780377 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-04b7c0eb-19c6-4712-ae18-f68db3e8a9ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:01.788200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-04b7c0eb-19c6-4712-ae18-f68db3e8a9ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.172050 Feb 21 01:11:01.788795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1216/2247] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:01 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:02.420765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-7fcaa479-4d10-4ba3-8b24-32f3a321f95d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:02.421709 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-7fcaa479-4d10-4ba3-8b24-32f3a321f95d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:02.432459 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fcaa479-4d10-4ba3-8b24-32f3a321f95d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:02.433221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fcaa479-4d10-4ba3-8b24-32f3a321f95d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.434504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fcaa479-4d10-4ba3-8b24-32f3a321f95d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:02.435214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-7fcaa479-4d10-4ba3-8b24-32f3a321f95d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.497591 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-7fcaa479-4d10-4ba3-8b24-32f3a321f95d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:02.505965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-7fcaa479-4d10-4ba3-8b24-32f3a321f95d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091507 Feb 21 01:11:02.506542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1032/2248] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:02 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:02.809252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ffed6c6e-33cd-466a-b723-a1142f285235 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:02.810228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ffed6c6e-33cd-466a-b723-a1142f285235 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:02.820924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffed6c6e-33cd-466a-b723-a1142f285235 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:02.821676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffed6c6e-33cd-466a-b723-a1142f285235 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.822988 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffed6c6e-33cd-466a-b723-a1142f285235 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:02.823702 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ffed6c6e-33cd-466a-b723-a1142f285235 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:02.960257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ffed6c6e-33cd-466a-b723-a1142f285235 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:02.968303 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ffed6c6e-33cd-466a-b723-a1142f285235 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165291 Feb 21 01:11:02.968924 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1217/2249] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:02 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:03.527651 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ebbe651-98b3-444a-8dfc-7d05aa37c814 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:03.528721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6ebbe651-98b3-444a-8dfc-7d05aa37c814 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:03.539023 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ebbe651-98b3-444a-8dfc-7d05aa37c814 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:03.539868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ebbe651-98b3-444a-8dfc-7d05aa37c814 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:03.541204 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ebbe651-98b3-444a-8dfc-7d05aa37c814 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:03.541926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ebbe651-98b3-444a-8dfc-7d05aa37c814 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:03.605105 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ebbe651-98b3-444a-8dfc-7d05aa37c814 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:03.614149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ebbe651-98b3-444a-8dfc-7d05aa37c814 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093013 Feb 21 01:11:03.614738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1033/2250] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:03 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:03.993984 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-ba897faa-c2dd-4261-943b-d37d7c50a0d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:03.995006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-ba897faa-c2dd-4261-943b-d37d7c50a0d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:04.004131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba897faa-c2dd-4261-943b-d37d7c50a0d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:04.004645 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba897faa-c2dd-4261-943b-d37d7c50a0d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:04.005424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba897faa-c2dd-4261-943b-d37d7c50a0d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:04.005865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-ba897faa-c2dd-4261-943b-d37d7c50a0d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:04.147973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-ba897faa-c2dd-4261-943b-d37d7c50a0d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:04.156445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-ba897faa-c2dd-4261-943b-d37d7c50a0d9 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168832 Feb 21 01:11:04.157050 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1218/2251] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:03 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:04.641876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fad29a4f-2c72-49d3-8716-7c387fd0e265 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:04.642999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fad29a4f-2c72-49d3-8716-7c387fd0e265 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:04.653775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fad29a4f-2c72-49d3-8716-7c387fd0e265 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:04.654519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fad29a4f-2c72-49d3-8716-7c387fd0e265 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:04.655788 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fad29a4f-2c72-49d3-8716-7c387fd0e265 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:04.656564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fad29a4f-2c72-49d3-8716-7c387fd0e265 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:04.732803 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fad29a4f-2c72-49d3-8716-7c387fd0e265 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:04.741207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fad29a4f-2c72-49d3-8716-7c387fd0e265 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.105900 Feb 21 01:11:04.741766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1034/2252] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:04 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:05.172979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-742809d3-35f9-49f7-a7e9-aa40329ea5d4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:05.173564 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-742809d3-35f9-49f7-a7e9-aa40329ea5d4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:05.180748 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-742809d3-35f9-49f7-a7e9-aa40329ea5d4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:05.181198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-742809d3-35f9-49f7-a7e9-aa40329ea5d4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:05.181970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-742809d3-35f9-49f7-a7e9-aa40329ea5d4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:05.182400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-742809d3-35f9-49f7-a7e9-aa40329ea5d4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:05.335249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-742809d3-35f9-49f7-a7e9-aa40329ea5d4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:05.345338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-742809d3-35f9-49f7-a7e9-aa40329ea5d4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176207 Feb 21 01:11:05.345916 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1219/2253] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:05 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:05.761120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-07a8651b-80ec-48bb-a939-4f10416b5b85 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:05.762181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-07a8651b-80ec-48bb-a939-4f10416b5b85 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:05.770409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07a8651b-80ec-48bb-a939-4f10416b5b85 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:05.770845 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07a8651b-80ec-48bb-a939-4f10416b5b85 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:05.771623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07a8651b-80ec-48bb-a939-4f10416b5b85 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:05.772050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07a8651b-80ec-48bb-a939-4f10416b5b85 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:05.843429 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-07a8651b-80ec-48bb-a939-4f10416b5b85 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:05.852008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-07a8651b-80ec-48bb-a939-4f10416b5b85 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096540 Feb 21 01:11:05.852599 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1035/2254] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:05 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:06.366330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6db4ddca-f48e-46e6-a7f1-8644e32e3068 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:06.367278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6db4ddca-f48e-46e6-a7f1-8644e32e3068 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:06.377273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6db4ddca-f48e-46e6-a7f1-8644e32e3068 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:06.377721 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6db4ddca-f48e-46e6-a7f1-8644e32e3068 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:06.378484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6db4ddca-f48e-46e6-a7f1-8644e32e3068 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:06.378922 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6db4ddca-f48e-46e6-a7f1-8644e32e3068 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:06.524955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6db4ddca-f48e-46e6-a7f1-8644e32e3068 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:06.534865 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6db4ddca-f48e-46e6-a7f1-8644e32e3068 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.174759 Feb 21 01:11:06.535538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1220/2255] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:06 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:06.873062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1fb90532-524f-4599-9c52-8b8604643112 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:06.874036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1fb90532-524f-4599-9c52-8b8604643112 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:06.882102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1fb90532-524f-4599-9c52-8b8604643112 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:06.882542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1fb90532-524f-4599-9c52-8b8604643112 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:06.883309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1fb90532-524f-4599-9c52-8b8604643112 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:06.883739 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1fb90532-524f-4599-9c52-8b8604643112 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:06.953101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1fb90532-524f-4599-9c52-8b8604643112 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:06.961183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1fb90532-524f-4599-9c52-8b8604643112 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.094383 Feb 21 01:11:06.961742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1036/2256] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:06 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:07.556639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7fc1f64a-2a8c-46f4-b070-d8d89f01605d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:07.557252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7fc1f64a-2a8c-46f4-b070-d8d89f01605d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:07.564052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7fc1f64a-2a8c-46f4-b070-d8d89f01605d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:07.564637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7fc1f64a-2a8c-46f4-b070-d8d89f01605d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:07.565411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7fc1f64a-2a8c-46f4-b070-d8d89f01605d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:07.565842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7fc1f64a-2a8c-46f4-b070-d8d89f01605d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:07.702662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7fc1f64a-2a8c-46f4-b070-d8d89f01605d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:07.711195 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7fc1f64a-2a8c-46f4-b070-d8d89f01605d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.158294 Feb 21 01:11:07.711882 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1221/2257] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:07 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:07.982522 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3496a641-903d-485d-830b-da7574bfef7d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:07.983449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3496a641-903d-485d-830b-da7574bfef7d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:07.991350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3496a641-903d-485d-830b-da7574bfef7d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:07.991800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3496a641-903d-485d-830b-da7574bfef7d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:07.992627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3496a641-903d-485d-830b-da7574bfef7d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:07.993051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3496a641-903d-485d-830b-da7574bfef7d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:08.062407 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3496a641-903d-485d-830b-da7574bfef7d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:08.070446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3496a641-903d-485d-830b-da7574bfef7d tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.094378 Feb 21 01:11:08.071010 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1037/2258] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:07 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:08.732181 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-83091d4a-87a5-4dd1-b4f2-1834725f0e18 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:08.732812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-83091d4a-87a5-4dd1-b4f2-1834725f0e18 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:08.739572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83091d4a-87a5-4dd1-b4f2-1834725f0e18 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:08.740019 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83091d4a-87a5-4dd1-b4f2-1834725f0e18 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:08.740853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83091d4a-87a5-4dd1-b4f2-1834725f0e18 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:08.741311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-83091d4a-87a5-4dd1-b4f2-1834725f0e18 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:08.896805 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-83091d4a-87a5-4dd1-b4f2-1834725f0e18 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:08.905158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-83091d4a-87a5-4dd1-b4f2-1834725f0e18 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176835 Feb 21 01:11:08.905712 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1222/2259] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:08 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:09.090124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-53791d0c-911d-4d67-9203-9938f139ca51 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:09.091019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-53791d0c-911d-4d67-9203-9938f139ca51 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:09.099104 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53791d0c-911d-4d67-9203-9938f139ca51 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:09.099552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53791d0c-911d-4d67-9203-9938f139ca51 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:09.100325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53791d0c-911d-4d67-9203-9938f139ca51 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:09.100784 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-53791d0c-911d-4d67-9203-9938f139ca51 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:09.161471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-53791d0c-911d-4d67-9203-9938f139ca51 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:09.169326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-53791d0c-911d-4d67-9203-9938f139ca51 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085310 Feb 21 01:11:09.169900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1038/2260] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:09 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:09.926621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-452f3fbc-9caa-4702-9296-d13888394497 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:09.927513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-452f3fbc-9caa-4702-9296-d13888394497 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:09.938252 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-452f3fbc-9caa-4702-9296-d13888394497 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:09.939026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-452f3fbc-9caa-4702-9296-d13888394497 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:09.940080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-452f3fbc-9caa-4702-9296-d13888394497 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:09.940543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-452f3fbc-9caa-4702-9296-d13888394497 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:10.088362 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-452f3fbc-9caa-4702-9296-d13888394497 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:10.096366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-452f3fbc-9caa-4702-9296-d13888394497 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.176209 Feb 21 01:11:10.097060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1223/2261] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:09 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:10.190252 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f1a6432f-01cd-4fac-a891-7b918b8396ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:10.191171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f1a6432f-01cd-4fac-a891-7b918b8396ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:10.201855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1a6432f-01cd-4fac-a891-7b918b8396ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:10.202596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1a6432f-01cd-4fac-a891-7b918b8396ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:10.203840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1a6432f-01cd-4fac-a891-7b918b8396ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:10.204653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f1a6432f-01cd-4fac-a891-7b918b8396ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:10.265502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f1a6432f-01cd-4fac-a891-7b918b8396ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:10.274010 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f1a6432f-01cd-4fac-a891-7b918b8396ca tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.090253 Feb 21 01:11:10.274575 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1039/2262] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:10 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:11.117568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f179ff8f-1980-4f76-987b-493f246459ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:11.118543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f179ff8f-1980-4f76-987b-493f246459ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:11.129484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f179ff8f-1980-4f76-987b-493f246459ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:11.130237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f179ff8f-1980-4f76-987b-493f246459ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:11.131525 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f179ff8f-1980-4f76-987b-493f246459ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:11.132287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f179ff8f-1980-4f76-987b-493f246459ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:11.288937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f179ff8f-1980-4f76-987b-493f246459ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:11.290849 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1d474da9-8499-41b6-9bcf-52b40dc7e0f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:11.291553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1d474da9-8499-41b6-9bcf-52b40dc7e0f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:11.297479 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f179ff8f-1980-4f76-987b-493f246459ef tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.186195 Feb 21 01:11:11.298061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1224/2263] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:11 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:11.298268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d474da9-8499-41b6-9bcf-52b40dc7e0f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:11.298661 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d474da9-8499-41b6-9bcf-52b40dc7e0f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:11.299587 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d474da9-8499-41b6-9bcf-52b40dc7e0f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:11.300074 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1d474da9-8499-41b6-9bcf-52b40dc7e0f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:11.360240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1d474da9-8499-41b6-9bcf-52b40dc7e0f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:11.368380 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1d474da9-8499-41b6-9bcf-52b40dc7e0f1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081220 Feb 21 01:11:11.369120 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1040/2264] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:11 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:12.318888 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4101b98c-242f-499c-ad73-7c7a66cbb63f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:12.319859 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4101b98c-242f-499c-ad73-7c7a66cbb63f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:12.330538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4101b98c-242f-499c-ad73-7c7a66cbb63f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:12.331290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4101b98c-242f-499c-ad73-7c7a66cbb63f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:12.332613 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4101b98c-242f-499c-ad73-7c7a66cbb63f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:12.333338 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4101b98c-242f-499c-ad73-7c7a66cbb63f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:12.386495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fe42b0d1-3f3e-4d94-a87d-d19d538825fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:12.387130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fe42b0d1-3f3e-4d94-a87d-d19d538825fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:12.394101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe42b0d1-3f3e-4d94-a87d-d19d538825fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:12.394546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe42b0d1-3f3e-4d94-a87d-d19d538825fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:12.395329 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe42b0d1-3f3e-4d94-a87d-d19d538825fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:12.395757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fe42b0d1-3f3e-4d94-a87d-d19d538825fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:12.459284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fe42b0d1-3f3e-4d94-a87d-d19d538825fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:12.467494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fe42b0d1-3f3e-4d94-a87d-d19d538825fb tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.084782 Feb 21 01:11:12.468072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1041/2265] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:12 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:12.475754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4101b98c-242f-499c-ad73-7c7a66cbb63f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:12.484037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4101b98c-242f-499c-ad73-7c7a66cbb63f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.171670 Feb 21 01:11:12.484639 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1225/2266] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:12 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:13.487781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-6ceeff47-64fb-40ed-9205-f1cba2af1474 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:13.488495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-6ceeff47-64fb-40ed-9205-f1cba2af1474 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:13.496278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ceeff47-64fb-40ed-9205-f1cba2af1474 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:13.496857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ceeff47-64fb-40ed-9205-f1cba2af1474 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:13.497757 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ceeff47-64fb-40ed-9205-f1cba2af1474 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:13.498256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-6ceeff47-64fb-40ed-9205-f1cba2af1474 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:13.502300 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9d9225a8-6919-4561-9a5d-a529cc3f3262 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:13.503100 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9d9225a8-6919-4561-9a5d-a529cc3f3262 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:13.510827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d9225a8-6919-4561-9a5d-a529cc3f3262 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:13.511350 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d9225a8-6919-4561-9a5d-a529cc3f3262 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:13.512257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d9225a8-6919-4561-9a5d-a529cc3f3262 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:13.512808 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9d9225a8-6919-4561-9a5d-a529cc3f3262 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:13.563536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-6ceeff47-64fb-40ed-9205-f1cba2af1474 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:13.571742 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-6ceeff47-64fb-40ed-9205-f1cba2af1474 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089556 Feb 21 01:11:13.572212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1042/2267] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:13 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:13.649853 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-9d9225a8-6919-4561-9a5d-a529cc3f3262 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:13.657710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9d9225a8-6919-4561-9a5d-a529cc3f3262 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.159933 Feb 21 01:11:13.658424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1226/2268] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:13 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:14.591991 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-03ebb1c4-3245-47da-ae3e-ed9c40328894 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:14.593059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-03ebb1c4-3245-47da-ae3e-ed9c40328894 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:14.601328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-03ebb1c4-3245-47da-ae3e-ed9c40328894 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:14.601729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-03ebb1c4-3245-47da-ae3e-ed9c40328894 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:14.602546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-03ebb1c4-3245-47da-ae3e-ed9c40328894 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:14.602967 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-03ebb1c4-3245-47da-ae3e-ed9c40328894 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:14.666696 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-03ebb1c4-3245-47da-ae3e-ed9c40328894 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:14.674347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5aa5e6f7-e96b-4db8-a29b-4e818e5add8d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:14.674880 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-03ebb1c4-3245-47da-ae3e-ed9c40328894 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088942 Feb 21 01:11:14.674992 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5aa5e6f7-e96b-4db8-a29b-4e818e5add8d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:14.677139 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1043/2269] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:14 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:14.681703 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5aa5e6f7-e96b-4db8-a29b-4e818e5add8d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:14.682148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5aa5e6f7-e96b-4db8-a29b-4e818e5add8d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:14.682935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5aa5e6f7-e96b-4db8-a29b-4e818e5add8d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:14.683367 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5aa5e6f7-e96b-4db8-a29b-4e818e5add8d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:14.844080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5aa5e6f7-e96b-4db8-a29b-4e818e5add8d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:14.852718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5aa5e6f7-e96b-4db8-a29b-4e818e5add8d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.182077 Feb 21 01:11:14.853293 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1227/2270] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:14 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:11:15.695589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ac1305ef-b35d-4901-a5f6-dd487ffa279f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:15.696707 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ac1305ef-b35d-4901-a5f6-dd487ffa279f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:15.707170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ac1305ef-b35d-4901-a5f6-dd487ffa279f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:15.707608 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ac1305ef-b35d-4901-a5f6-dd487ffa279f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:15.708375 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ac1305ef-b35d-4901-a5f6-dd487ffa279f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:15.708827 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ac1305ef-b35d-4901-a5f6-dd487ffa279f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:15.775900 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ac1305ef-b35d-4901-a5f6-dd487ffa279f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:15.786776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ac1305ef-b35d-4901-a5f6-dd487ffa279f tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.097417 Feb 21 01:11:15.787286 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1044/2271] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:15 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:15.873672 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-832cfb84-3a4c-4466-b1b9-95f4e8a454a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:15.874665 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-832cfb84-3a4c-4466-b1b9-95f4e8a454a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:15.882759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-832cfb84-3a4c-4466-b1b9-95f4e8a454a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:15.883200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-832cfb84-3a4c-4466-b1b9-95f4e8a454a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:15.883961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-832cfb84-3a4c-4466-b1b9-95f4e8a454a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:15.884382 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-832cfb84-3a4c-4466-b1b9-95f4e8a454a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.027029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-832cfb84-3a4c-4466-b1b9-95f4e8a454a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:16.035305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-832cfb84-3a4c-4466-b1b9-95f4e8a454a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.167985 Feb 21 01:11:16.035941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1228/2272] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:15 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:16.806220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-25e5e5cc-daec-4d45-8951-28bc0d859f04 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:16.806935 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-25e5e5cc-daec-4d45-8951-28bc0d859f04 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:16.815906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25e5e5cc-daec-4d45-8951-28bc0d859f04 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:16.816384 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25e5e5cc-daec-4d45-8951-28bc0d859f04 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.817239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25e5e5cc-daec-4d45-8951-28bc0d859f04 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:16.817647 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25e5e5cc-daec-4d45-8951-28bc0d859f04 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:16.886190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-25e5e5cc-daec-4d45-8951-28bc0d859f04 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:16.894680 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-25e5e5cc-daec-4d45-8951-28bc0d859f04 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093617 Feb 21 01:11:16.895252 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1045/2273] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:16 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:17.056772 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8718e04e-f2e9-4d67-99dd-ee6c64d2cbae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:17.057700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8718e04e-f2e9-4d67-99dd-ee6c64d2cbae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:17.068440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8718e04e-f2e9-4d67-99dd-ee6c64d2cbae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:17.069200 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8718e04e-f2e9-4d67-99dd-ee6c64d2cbae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:17.070452 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8718e04e-f2e9-4d67-99dd-ee6c64d2cbae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:17.071150 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8718e04e-f2e9-4d67-99dd-ee6c64d2cbae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:17.222431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8718e04e-f2e9-4d67-99dd-ee6c64d2cbae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:17.230710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8718e04e-f2e9-4d67-99dd-ee6c64d2cbae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.180545 Feb 21 01:11:17.231281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1229/2274] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:17 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:17.915802 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d5bed737-f981-4114-94eb-9401b82552e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:17.916652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d5bed737-f981-4114-94eb-9401b82552e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:17.926612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5bed737-f981-4114-94eb-9401b82552e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:17.927058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5bed737-f981-4114-94eb-9401b82552e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:17.927832 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5bed737-f981-4114-94eb-9401b82552e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:17.928262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5bed737-f981-4114-94eb-9401b82552e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:17.990434 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d5bed737-f981-4114-94eb-9401b82552e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:17.998825 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d5bed737-f981-4114-94eb-9401b82552e1 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.089383 Feb 21 01:11:17.999394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1046/2275] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:17 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:18.389374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d4180ed1-a67a-4642-9a18-c2e3d53c5f87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:18.390005 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d4180ed1-a67a-4642-9a18-c2e3d53c5f87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:18.397035 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4180ed1-a67a-4642-9a18-c2e3d53c5f87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:18.397475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4180ed1-a67a-4642-9a18-c2e3d53c5f87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:18.398249 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4180ed1-a67a-4642-9a18-c2e3d53c5f87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:18.398676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d4180ed1-a67a-4642-9a18-c2e3d53c5f87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:18.541182 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d4180ed1-a67a-4642-9a18-c2e3d53c5f87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:18.549704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d4180ed1-a67a-4642-9a18-c2e3d53c5f87 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.303876 Feb 21 01:11:18.550278 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1230/2276] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:18 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:19.016908 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b3df146b-bed3-45e4-a3c5-7568aaf33afe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:19.017814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b3df146b-bed3-45e4-a3c5-7568aaf33afe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:19.025198 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b3df146b-bed3-45e4-a3c5-7568aaf33afe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.025645 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b3df146b-bed3-45e4-a3c5-7568aaf33afe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.026409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b3df146b-bed3-45e4-a3c5-7568aaf33afe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.026834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b3df146b-bed3-45e4-a3c5-7568aaf33afe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.097442 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b3df146b-bed3-45e4-a3c5-7568aaf33afe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:19.109788 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b3df146b-bed3-45e4-a3c5-7568aaf33afe tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.096567 Feb 21 01:11:19.110547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1047/2277] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:19 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:19.569204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-03932e5c-5fa7-4b53-8c68-325c50377118 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:19.569841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-03932e5c-5fa7-4b53-8c68-325c50377118 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:19.577451 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03932e5c-5fa7-4b53-8c68-325c50377118 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.577939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03932e5c-5fa7-4b53-8c68-325c50377118 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.578812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03932e5c-5fa7-4b53-8c68-325c50377118 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:19.579293 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-03932e5c-5fa7-4b53-8c68-325c50377118 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:19.720432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-03932e5c-5fa7-4b53-8c68-325c50377118 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:19.729273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-03932e5c-5fa7-4b53-8c68-325c50377118 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.165790 Feb 21 01:11:19.729849 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1231/2278] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:19 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:20.132211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f0f5054d-607f-4719-a86f-510cde1e6ced tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:20.133251 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f0f5054d-607f-4719-a86f-510cde1e6ced tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:20.144652 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0f5054d-607f-4719-a86f-510cde1e6ced tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.145532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0f5054d-607f-4719-a86f-510cde1e6ced tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.146304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0f5054d-607f-4719-a86f-510cde1e6ced tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.146758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f0f5054d-607f-4719-a86f-510cde1e6ced tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.206989 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f0f5054d-607f-4719-a86f-510cde1e6ced tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:20.215060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f0f5054d-607f-4719-a86f-510cde1e6ced tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.088971 Feb 21 01:11:20.215614 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1048/2279] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:20 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:20.750238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-644aed52-d6e1-48fb-a408-c076dc49ba00 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:20.751174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-644aed52-d6e1-48fb-a408-c076dc49ba00 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:20.761906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-644aed52-d6e1-48fb-a408-c076dc49ba00 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.762670 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-644aed52-d6e1-48fb-a408-c076dc49ba00 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.763936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-644aed52-d6e1-48fb-a408-c076dc49ba00 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:20.764697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-644aed52-d6e1-48fb-a408-c076dc49ba00 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:20.908411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-644aed52-d6e1-48fb-a408-c076dc49ba00 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:20.917048 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-644aed52-d6e1-48fb-a408-c076dc49ba00 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173012 Feb 21 01:11:20.917592 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1232/2280] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:20 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:21.235855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-54f37e28-4c4f-41c8-8628-e3d54d3be06a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:21.236847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-54f37e28-4c4f-41c8-8628-e3d54d3be06a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:21.247240 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54f37e28-4c4f-41c8-8628-e3d54d3be06a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.247979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54f37e28-4c4f-41c8-8628-e3d54d3be06a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.249306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54f37e28-4c4f-41c8-8628-e3d54d3be06a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.250008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-54f37e28-4c4f-41c8-8628-e3d54d3be06a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.312619 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-54f37e28-4c4f-41c8-8628-e3d54d3be06a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:21.320621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-54f37e28-4c4f-41c8-8628-e3d54d3be06a tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.091052 Feb 21 01:11:21.321185 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1049/2281] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:21 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:21.938274 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2d235a98-abbd-4a96-8d99-42ceaabe02ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:21.939166 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2d235a98-abbd-4a96-8d99-42ceaabe02ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:21.947291 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d235a98-abbd-4a96-8d99-42ceaabe02ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.947745 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d235a98-abbd-4a96-8d99-42ceaabe02ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:21.948581 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d235a98-abbd-4a96-8d99-42ceaabe02ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:21.949013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2d235a98-abbd-4a96-8d99-42ceaabe02ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.108017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2d235a98-abbd-4a96-8d99-42ceaabe02ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:22.118193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2d235a98-abbd-4a96-8d99-42ceaabe02ae tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.186444 Feb 21 01:11:22.118763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1233/2282] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:21 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:22.338347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-14133826-d5f1-4734-87c0-55471a3f1f29 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:22.338937 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-14133826-d5f1-4734-87c0-55471a3f1f29 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:22.345962 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-14133826-d5f1-4734-87c0-55471a3f1f29 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.346410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-14133826-d5f1-4734-87c0-55471a3f1f29 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.347172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-14133826-d5f1-4734-87c0-55471a3f1f29 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:22.347600 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-14133826-d5f1-4734-87c0-55471a3f1f29 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:22.412654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-14133826-d5f1-4734-87c0-55471a3f1f29 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:22.420974 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-14133826-d5f1-4734-87c0-55471a3f1f29 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.086237 Feb 21 01:11:22.421568 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1050/2283] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:22 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:23.139289 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4c23c993-ef1e-483b-82ca-26fec59fb766 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:23.140275 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4c23c993-ef1e-483b-82ca-26fec59fb766 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:23.149586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c23c993-ef1e-483b-82ca-26fec59fb766 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:23.150033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c23c993-ef1e-483b-82ca-26fec59fb766 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:23.150803 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c23c993-ef1e-483b-82ca-26fec59fb766 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:23.151230 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4c23c993-ef1e-483b-82ca-26fec59fb766 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:23.290215 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4c23c993-ef1e-483b-82ca-26fec59fb766 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:23.301813 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4c23c993-ef1e-483b-82ca-26fec59fb766 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168800 Feb 21 01:11:23.302569 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1234/2284] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:23 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:23.441986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-91f70d16-b6fd-4219-8965-5fea2d63b793 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:23.442853 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-91f70d16-b6fd-4219-8965-5fea2d63b793 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:23.450150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91f70d16-b6fd-4219-8965-5fea2d63b793 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:23.450621 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91f70d16-b6fd-4219-8965-5fea2d63b793 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:23.451421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91f70d16-b6fd-4219-8965-5fea2d63b793 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:23.451867 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-91f70d16-b6fd-4219-8965-5fea2d63b793 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:23.512043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-91f70d16-b6fd-4219-8965-5fea2d63b793 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:23.521034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-91f70d16-b6fd-4219-8965-5fea2d63b793 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085411 Feb 21 01:11:23.521612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1051/2285] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:23 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:24.323187 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0356791d-2a00-4878-bc34-9f5de045645e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:24.324118 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0356791d-2a00-4878-bc34-9f5de045645e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:24.334597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0356791d-2a00-4878-bc34-9f5de045645e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.335041 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0356791d-2a00-4878-bc34-9f5de045645e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.335821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0356791d-2a00-4878-bc34-9f5de045645e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.336237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0356791d-2a00-4878-bc34-9f5de045645e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.481018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0356791d-2a00-4878-bc34-9f5de045645e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:24.489657 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0356791d-2a00-4878-bc34-9f5de045645e tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173027 Feb 21 01:11:24.490313 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1235/2286] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:24 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:24.539246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3770a6d6-e342-4b6f-8929-ae02c9ab90b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:24.539866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3770a6d6-e342-4b6f-8929-ae02c9ab90b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:24.546799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3770a6d6-e342-4b6f-8929-ae02c9ab90b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.547242 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3770a6d6-e342-4b6f-8929-ae02c9ab90b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.548051 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3770a6d6-e342-4b6f-8929-ae02c9ab90b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:24.548540 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3770a6d6-e342-4b6f-8929-ae02c9ab90b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:24.608219 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3770a6d6-e342-4b6f-8929-ae02c9ab90b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:24.616691 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3770a6d6-e342-4b6f-8929-ae02c9ab90b3 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081279 Feb 21 01:11:24.617275 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1052/2287] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:24 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:25.516131 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7c6a55ef-76bb-44c3-92ca-2b055c2500a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:25.517174 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7c6a55ef-76bb-44c3-92ca-2b055c2500a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:25.528461 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c6a55ef-76bb-44c3-92ca-2b055c2500a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.529204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c6a55ef-76bb-44c3-92ca-2b055c2500a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.530539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c6a55ef-76bb-44c3-92ca-2b055c2500a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.531254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7c6a55ef-76bb-44c3-92ca-2b055c2500a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.633570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fa7d1942-0268-44e0-815e-ca2bb7d4203e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:25.634190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fa7d1942-0268-44e0-815e-ca2bb7d4203e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:25.640859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa7d1942-0268-44e0-815e-ca2bb7d4203e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.641308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa7d1942-0268-44e0-815e-ca2bb7d4203e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.642085 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa7d1942-0268-44e0-815e-ca2bb7d4203e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:25.642516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fa7d1942-0268-44e0-815e-ca2bb7d4203e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:25.670000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7c6a55ef-76bb-44c3-92ca-2b055c2500a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:25.678116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7c6a55ef-76bb-44c3-92ca-2b055c2500a6 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.168095 Feb 21 01:11:25.678710 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1236/2288] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:25 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:25.706666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fa7d1942-0268-44e0-815e-ca2bb7d4203e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:25.714883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fa7d1942-0268-44e0-815e-ca2bb7d4203e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.085175 Feb 21 01:11:25.715471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1053/2289] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:25 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:26.699444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e4242858-9f11-41e3-bc95-1b0b31b5ddb8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:26.700439 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e4242858-9f11-41e3-bc95-1b0b31b5ddb8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:26.710401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4242858-9f11-41e3-bc95-1b0b31b5ddb8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.710847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4242858-9f11-41e3-bc95-1b0b31b5ddb8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.711624 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4242858-9f11-41e3-bc95-1b0b31b5ddb8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.712058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4242858-9f11-41e3-bc95-1b0b31b5ddb8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.732366 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-273b449d-c014-4d7c-9672-f5c8d1310189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:26.733098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-273b449d-c014-4d7c-9672-f5c8d1310189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:26.740068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-273b449d-c014-4d7c-9672-f5c8d1310189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.740542 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-273b449d-c014-4d7c-9672-f5c8d1310189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.741321 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-273b449d-c014-4d7c-9672-f5c8d1310189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:26.741746 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-273b449d-c014-4d7c-9672-f5c8d1310189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:26.801413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-273b449d-c014-4d7c-9672-f5c8d1310189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:26.809627 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-273b449d-c014-4d7c-9672-f5c8d1310189 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.081322 Feb 21 01:11:26.810277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1054/2290] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:26 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:26.845491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e4242858-9f11-41e3-bc95-1b0b31b5ddb8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:26.857726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e4242858-9f11-41e3-bc95-1b0b31b5ddb8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.164421 Feb 21 01:11:26.858541 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1237/2291] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:26 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:27.830016 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-f49b6c58-b650-44c1-bf35-c014a2329a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:27.830889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-f49b6c58-b650-44c1-bf35-c014a2329a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:27.841573 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f49b6c58-b650-44c1-bf35-c014a2329a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.842311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f49b6c58-b650-44c1-bf35-c014a2329a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.843582 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f49b6c58-b650-44c1-bf35-c014a2329a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.844284 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-f49b6c58-b650-44c1-bf35-c014a2329a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.875083 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-40a330b3-1964-411e-a985-a48619095354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:27.875653 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-40a330b3-1964-411e-a985-a48619095354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:27.882464 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40a330b3-1964-411e-a985-a48619095354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.882910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40a330b3-1964-411e-a985-a48619095354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.883731 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40a330b3-1964-411e-a985-a48619095354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:27.884161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-40a330b3-1964-411e-a985-a48619095354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:27.909014 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-f49b6c58-b650-44c1-bf35-c014a2329a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:27.917469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-f49b6c58-b650-44c1-bf35-c014a2329a07 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.093781 Feb 21 01:11:27.926721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1055/2292] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:27 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:28.032686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-40a330b3-1964-411e-a985-a48619095354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:28.045047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-40a330b3-1964-411e-a985-a48619095354 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.173314 Feb 21 01:11:28.045841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1238/2293] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:27 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:28.935122 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-45225826-bfc5-4ec1-adaf-23060f7c9981 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:28.935793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-45225826-bfc5-4ec1-adaf-23060f7c9981 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] [instance: 1e018349-6a79-41ca-89e4-86d1bf355cd0] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:28.942721 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45225826-bfc5-4ec1-adaf-23060f7c9981 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.943165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45225826-bfc5-4ec1-adaf-23060f7c9981 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:28.943941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45225826-bfc5-4ec1-adaf-23060f7c9981 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:28.944373 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-45225826-bfc5-4ec1-adaf-23060f7c9981 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.009728 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-45225826-bfc5-4ec1-adaf-23060f7c9981 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e90616794a754083833c374f52ce1227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eecd8ed19485e9351a92ac0268585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:29.018337 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-45225826-bfc5-4ec1-adaf-23060f7c9981 tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0" status: 200 len: 1389 microversion: 2.1 time: 0.087422 Feb 21 01:11:29.019242 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1056/2294] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:28 2022] GET /compute/v2.1/servers/1e018349-6a79-41ca-89e4-86d1bf355cd0 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:29.034841 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-265c7f9f-d5fd-4da9-8a20-9da703b5219e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] Calling method '.version_select at 0x7fe56caed310>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:29.053558 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-265c7f9f-d5fd-4da9-8a20-9da703b5219e tempest-TestMinimumBasicScenario-596572127 tempest-TestMinimumBasicScenario-596572127-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-508035979" status: 202 len: 0 microversion: 2.1 time: 0.022368 Feb 21 01:11:29.054065 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1239/2295] 10.222.0.72 () {58 vars in 1268 bytes} [Mon Feb 21 01:11:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-508035979 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:11:29.065826 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dac65beb-32d3-4131-9811-e5009f9dcd01 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:11:29.066431 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dac65beb-32d3-4131-9811-e5009f9dcd01 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:11:29.072548 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dac65beb-32d3-4131-9811-e5009f9dcd01 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.072968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dac65beb-32d3-4131-9811-e5009f9dcd01 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.073762 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dac65beb-32d3-4131-9811-e5009f9dcd01 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:11:29.074163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dac65beb-32d3-4131-9811-e5009f9dcd01 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:11:29.214666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dac65beb-32d3-4131-9811-e5009f9dcd01 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:11:29.222624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dac65beb-32d3-4131-9811-e5009f9dcd01 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c" status: 200 len: 1559 microversion: 2.1 time: 0.160458 Feb 21 01:11:29.223228 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1057/2296] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:11:29 2022] GET /compute/v2.1/servers/1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:11:35.336897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:11:35.337546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:13:16.204807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-e4e49e8c-cf41-4700-b744-e8a9b4e4c8fa req-6fdda297-58d1-437b-bde4-c39e51405d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c", "name": "network-vif-deleted", "tag": "1187a97b-2a24-44bd-8064-9bcc8be5eb03"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:16.206430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:16.206430 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:13:16.214471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-e4e49e8c-cf41-4700-b744-e8a9b4e4c8fa req-6fdda297-58d1-437b-bde4-c39e51405d54 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:16.214915 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-e4e49e8c-cf41-4700-b744-e8a9b4e4c8fa req-6fdda297-58d1-437b-bde4-c39e51405d54 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:16.231436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-e4e49e8c-cf41-4700-b744-e8a9b4e4c8fa req-6fdda297-58d1-437b-bde4-c39e51405d54 service nova] Creating event network-vif-deleted:1187a97b-2a24-44bd-8064-9bcc8be5eb03 for instance 1e1ff019-0c24-4c6d-b2d4-ffdb2b59d86c on hv-cinder-81322 Feb 21 01:13:16.236792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-e4e49e8c-cf41-4700-b744-e8a9b4e4c8fa req-6fdda297-58d1-437b-bde4-c39e51405d54 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165049 Feb 21 01:13:16.237387 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1240/2297] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:25.770008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1282088835", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "3d51b0ba-44df-4d2b-a4e2-f678b8211f66"}]}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:25.829856 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.network.neutron [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] validate_networks() for [('3d51b0ba-44df-4d2b-a4e2-f678b8211f66', None, None, None, None, None)] {{(pid=123097) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:13:26.313569 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Flavor limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:13:26.313971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Image limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:13:26.314444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Flavor pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:13:26.314852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Image pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:13:26.315303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:13:26.324556 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:26.325006 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:26.325808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:26.326248 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:26.343743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Getting quotas for project 57be6173077b4dedaa6514ff1841b515. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:13:26.347741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Getting quotas for user 45e624bab4554a3fa8e1a028a81b6c8b and project 57be6173077b4dedaa6514ff1841b515. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:13:26.358491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Going to run 1 instances... {{(pid=123097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:13:26.361239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:13:26.414493 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d75748f4-a741-4854-bbea-7bf210157135 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649815 Feb 21 01:13:26.420017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1058/2298] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 01:13:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:13:26.429533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-448ba149-aeb9-4af1-b48f-36242b7dac04 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:26.430238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-448ba149-aeb9-4af1-b48f-36242b7dac04 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:26.495966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-448ba149-aeb9-4af1-b48f-36242b7dac04 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:26.502487 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-448ba149-aeb9-4af1-b48f-36242b7dac04 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1219 microversion: 2.1 time: 0.080948 Feb 21 01:13:26.503049 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1241/2299] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:26 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:13:27.525394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-07f3f72c-c020-42a7-ae10-3c15525270a4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:27.525394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-07f3f72c-c020-42a7-ae10-3c15525270a4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:27.532833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07f3f72c-c020-42a7-ae10-3c15525270a4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:27.532988 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07f3f72c-c020-42a7-ae10-3c15525270a4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:27.533891 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07f3f72c-c020-42a7-ae10-3c15525270a4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:27.536662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07f3f72c-c020-42a7-ae10-3c15525270a4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:27.606069 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-07f3f72c-c020-42a7-ae10-3c15525270a4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:27.616975 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-07f3f72c-c020-42a7-ae10-3c15525270a4 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1277 microversion: 2.1 time: 0.101258 Feb 21 01:13:27.617545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1059/2300] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:27 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:28.635648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b87efa32-7cff-43c9-9abb-e0e319b7f8f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:28.636468 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b87efa32-7cff-43c9-9abb-e0e319b7f8f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:28.644778 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b87efa32-7cff-43c9-9abb-e0e319b7f8f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:28.645299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b87efa32-7cff-43c9-9abb-e0e319b7f8f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:28.646919 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b87efa32-7cff-43c9-9abb-e0e319b7f8f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:28.647330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b87efa32-7cff-43c9-9abb-e0e319b7f8f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:28.655304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-ea38a6b3-4434-48dd-bd90-dc748aed7787 req-514f7ac9-264b-4a5c-9dc5-29ea7266b122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e068400-0ef6-4274-b849-e244399308de", "tag": "7eacbd89-325e-42bd-a90b-b2bd5e4b483f"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:28.656909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:28.656909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:13:28.664977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-ea38a6b3-4434-48dd-bd90-dc748aed7787 req-514f7ac9-264b-4a5c-9dc5-29ea7266b122 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:28.665413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-ea38a6b3-4434-48dd-bd90-dc748aed7787 req-514f7ac9-264b-4a5c-9dc5-29ea7266b122 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:28.678101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-ea38a6b3-4434-48dd-bd90-dc748aed7787 req-514f7ac9-264b-4a5c-9dc5-29ea7266b122 service nova] Creating event network-changed:7eacbd89-325e-42bd-a90b-b2bd5e4b483f for instance 9e068400-0ef6-4274-b849-e244399308de on hv-cinder-81322 Feb 21 01:13:28.693570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: ERROR oslo.messaging._drivers.impl_rabbit [req-ea38a6b3-4434-48dd-bd90-dc748aed7787 req-514f7ac9-264b-4a5c-9dc5-29ea7266b122 service nova] [a0e55c94-b474-4b59-a6d6-54072c569416] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:13:28.787197 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b87efa32-7cff-43c9-9abb-e0e319b7f8f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:28.794667 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b87efa32-7cff-43c9-9abb-e0e319b7f8f5 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1319 microversion: 2.1 time: 0.164567 Feb 21 01:13:28.795239 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1242/2301] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:28 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:29.700993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [req-ea38a6b3-4434-48dd-bd90-dc748aed7787 req-514f7ac9-264b-4a5c-9dc5-29ea7266b122 service nova] [a0e55c94-b474-4b59-a6d6-54072c569416] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 39242. Feb 21 01:13:29.704807 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-ea38a6b3-4434-48dd-bd90-dc748aed7787 req-514f7ac9-264b-4a5c-9dc5-29ea7266b122 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.053473 Feb 21 01:13:29.705408 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1060/2302] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:29.810817 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2916336b-b6a1-4ea6-9e23-58defe670af0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:29.811427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2916336b-b6a1-4ea6-9e23-58defe670af0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:29.817842 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2916336b-b6a1-4ea6-9e23-58defe670af0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:29.818318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2916336b-b6a1-4ea6-9e23-58defe670af0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:29.819107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2916336b-b6a1-4ea6-9e23-58defe670af0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:29.819536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2916336b-b6a1-4ea6-9e23-58defe670af0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:29.993128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2916336b-b6a1-4ea6-9e23-58defe670af0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:30.001396 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2916336b-b6a1-4ea6-9e23-58defe670af0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1319 microversion: 2.1 time: 0.194182 Feb 21 01:13:30.001949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1243/2303] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:29 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:31.019718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d188a451-41da-4e78-9c22-08f856dd6bba tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:31.020444 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d188a451-41da-4e78-9c22-08f856dd6bba tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:31.027052 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d188a451-41da-4e78-9c22-08f856dd6bba tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:31.027852 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d188a451-41da-4e78-9c22-08f856dd6bba tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:31.028744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d188a451-41da-4e78-9c22-08f856dd6bba tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:31.029171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d188a451-41da-4e78-9c22-08f856dd6bba tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:31.166749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d188a451-41da-4e78-9c22-08f856dd6bba tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:31.174907 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d188a451-41da-4e78-9c22-08f856dd6bba tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1319 microversion: 2.1 time: 0.160442 Feb 21 01:13:31.175486 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1061/2304] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:31 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:32.091887 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-223772178", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "993c65d5-6e44-4e76-85db-4181dda1f131"}]}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:32.150862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] validate_networks() for [('993c65d5-6e44-4e76-85db-4181dda1f131', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:13:32.192453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a44c7468-eb32-40d1-a408-7a683ea6f03a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:32.193298 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a44c7468-eb32-40d1-a408-7a683ea6f03a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:32.200082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a44c7468-eb32-40d1-a408-7a683ea6f03a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:32.200646 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a44c7468-eb32-40d1-a408-7a683ea6f03a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:32.201483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a44c7468-eb32-40d1-a408-7a683ea6f03a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:32.202099 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a44c7468-eb32-40d1-a408-7a683ea6f03a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:32.336601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a44c7468-eb32-40d1-a408-7a683ea6f03a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:32.343771 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a44c7468-eb32-40d1-a408-7a683ea6f03a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1319 microversion: 2.1 time: 0.155056 Feb 21 01:13:32.344307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1062/2305] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:32 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:32.505376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:13:32.505802 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:13:32.506273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:13:32.506682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:13:32.507090 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:13:32.520740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:32.521280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:32.522287 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:32.522709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:32.539295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Getting quotas for project 31af93e0c1fb451b8832a6683738d64c. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:13:32.543270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Getting quotas for user ab0b10226a8046099231bcd64e5fea9c and project 31af93e0c1fb451b8832a6683738d64c. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:13:32.554137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:13:32.556522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:13:32.600970 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c94b5ba8-5e93-4577-a42f-2a5e61f76a1d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512733 Feb 21 01:13:32.606531 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1244/2306] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 01:13:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:13:32.611878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c8f5f89a-ddcd-4008-84ee-023b1ebc1171 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:32.612514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c8f5f89a-ddcd-4008-84ee-023b1ebc1171 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:32.635411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:13:32.635873 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:13:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:13:32.673504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c8f5f89a-ddcd-4008-84ee-023b1ebc1171 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:32.680417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c8f5f89a-ddcd-4008-84ee-023b1ebc1171 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1213 microversion: 2.1 time: 0.072406 Feb 21 01:13:32.681073 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1063/2307] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:32 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:13:33.361360 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0f37c145-81b7-434f-b187-49fe0b90122d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:33.361946 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0f37c145-81b7-434f-b187-49fe0b90122d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:33.368491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f37c145-81b7-434f-b187-49fe0b90122d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:33.368940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f37c145-81b7-434f-b187-49fe0b90122d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:33.369715 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f37c145-81b7-434f-b187-49fe0b90122d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:33.370151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f37c145-81b7-434f-b187-49fe0b90122d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:33.508419 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0f37c145-81b7-434f-b187-49fe0b90122d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:33.516718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0f37c145-81b7-434f-b187-49fe0b90122d tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1319 microversion: 2.1 time: 0.159311 Feb 21 01:13:33.517256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1245/2308] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:33 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:33.696894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-52cf4ed8-8ce5-4013-986b-88ba03b43cb9 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:33.697479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-52cf4ed8-8ce5-4013-986b-88ba03b43cb9 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:33.706101 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52cf4ed8-8ce5-4013-986b-88ba03b43cb9 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:33.706620 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52cf4ed8-8ce5-4013-986b-88ba03b43cb9 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:33.707446 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52cf4ed8-8ce5-4013-986b-88ba03b43cb9 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:33.707885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-52cf4ed8-8ce5-4013-986b-88ba03b43cb9 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:33.780929 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-52cf4ed8-8ce5-4013-986b-88ba03b43cb9 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:33.788933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-52cf4ed8-8ce5-4013-986b-88ba03b43cb9 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1271 microversion: 2.1 time: 0.095714 Feb 21 01:13:33.789589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1064/2309] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:33 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:34.538402 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b2db3772-d112-459c-9e8e-ca7a87722395 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:34.539105 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b2db3772-d112-459c-9e8e-ca7a87722395 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:34.546102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b2db3772-d112-459c-9e8e-ca7a87722395 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.546648 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b2db3772-d112-459c-9e8e-ca7a87722395 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:34.547538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b2db3772-d112-459c-9e8e-ca7a87722395 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.548038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b2db3772-d112-459c-9e8e-ca7a87722395 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:34.700007 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b2db3772-d112-459c-9e8e-ca7a87722395 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:34.708367 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b2db3772-d112-459c-9e8e-ca7a87722395 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1319 microversion: 2.1 time: 0.177992 Feb 21 01:13:34.709720 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1246/2310] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:34 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:34.760350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-aa5fc7fd-082b-4ead-99cd-fe8e2fb16ea0 req-ca681f27-e81a-4a59-bf89-d1925696dc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e068400-0ef6-4274-b849-e244399308de", "name": "network-vif-plugged", "status": "completed", "tag": "7eacbd89-325e-42bd-a90b-b2bd5e4b483f"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:34.762477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:34.762477 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:13:34.770460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-aa5fc7fd-082b-4ead-99cd-fe8e2fb16ea0 req-ca681f27-e81a-4a59-bf89-d1925696dc05 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.771150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-aa5fc7fd-082b-4ead-99cd-fe8e2fb16ea0 req-ca681f27-e81a-4a59-bf89-d1925696dc05 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:34.783289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-aa5fc7fd-082b-4ead-99cd-fe8e2fb16ea0 req-ca681f27-e81a-4a59-bf89-d1925696dc05 service nova] Creating event network-vif-plugged:7eacbd89-325e-42bd-a90b-b2bd5e4b483f for instance 9e068400-0ef6-4274-b849-e244399308de on hv-cinder-81322 Feb 21 01:13:34.788247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-aa5fc7fd-082b-4ead-99cd-fe8e2fb16ea0 req-ca681f27-e81a-4a59-bf89-d1925696dc05 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031557 Feb 21 01:13:34.788878 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1065/2311] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:13:34.806950 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e1b202be-c317-45ff-b471-a2199c683149 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:34.807863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e1b202be-c317-45ff-b471-a2199c683149 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:34.814799 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1b202be-c317-45ff-b471-a2199c683149 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.815331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1b202be-c317-45ff-b471-a2199c683149 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:34.816189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1b202be-c317-45ff-b471-a2199c683149 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:34.816815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e1b202be-c317-45ff-b471-a2199c683149 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:35.002137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e1b202be-c317-45ff-b471-a2199c683149 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:35.010577 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e1b202be-c317-45ff-b471-a2199c683149 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.207357 Feb 21 01:13:35.011154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1247/2312] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:34 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:35.190559 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-062835e0-07c5-4255-ad52-0b98fb8e1c85 req-654ca3ee-8e48-4a97-b9ed-a8f1b5a449c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b", "tag": "52d257b1-864f-4de7-be9c-2f18f4d64b47"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:35.192381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:35.192381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:13:35.199938 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-062835e0-07c5-4255-ad52-0b98fb8e1c85 req-654ca3ee-8e48-4a97-b9ed-a8f1b5a449c8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:35.200376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-062835e0-07c5-4255-ad52-0b98fb8e1c85 req-654ca3ee-8e48-4a97-b9ed-a8f1b5a449c8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:35.211341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-062835e0-07c5-4255-ad52-0b98fb8e1c85 req-654ca3ee-8e48-4a97-b9ed-a8f1b5a449c8 service nova] Creating event network-changed:52d257b1-864f-4de7-be9c-2f18f4d64b47 for instance feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b on hv-cinder-81322 Feb 21 01:13:35.215848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-062835e0-07c5-4255-ad52-0b98fb8e1c85 req-654ca3ee-8e48-4a97-b9ed-a8f1b5a449c8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029387 Feb 21 01:13:35.216399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1066/2313] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:35.725658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6bd088f2-4282-45af-82e4-e0a3812f2b3a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:35.726222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6bd088f2-4282-45af-82e4-e0a3812f2b3a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:35.732977 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6bd088f2-4282-45af-82e4-e0a3812f2b3a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:35.733422 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6bd088f2-4282-45af-82e4-e0a3812f2b3a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:35.734189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6bd088f2-4282-45af-82e4-e0a3812f2b3a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:35.734612 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6bd088f2-4282-45af-82e4-e0a3812f2b3a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:35.869142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6bd088f2-4282-45af-82e4-e0a3812f2b3a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:35.876716 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6bd088f2-4282-45af-82e4-e0a3812f2b3a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1319 microversion: 2.1 time: 0.154755 Feb 21 01:13:35.877450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1248/2314] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:35 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:36.029390 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5f4671a9-b00c-4ccd-aab7-64471e0f45cd tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:36.030084 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5f4671a9-b00c-4ccd-aab7-64471e0f45cd tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:36.037175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f4671a9-b00c-4ccd-aab7-64471e0f45cd tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:36.037617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f4671a9-b00c-4ccd-aab7-64471e0f45cd tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:36.038376 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f4671a9-b00c-4ccd-aab7-64471e0f45cd tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:36.038819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5f4671a9-b00c-4ccd-aab7-64471e0f45cd tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:36.261612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5f4671a9-b00c-4ccd-aab7-64471e0f45cd tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:36.269602 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5f4671a9-b00c-4ccd-aab7-64471e0f45cd tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.245543 Feb 21 01:13:36.270185 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1067/2315] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:36 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:36.897201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-525807f6-4eb6-44c8-b9ae-bd3fa03b4270 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:36.897763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-525807f6-4eb6-44c8-b9ae-bd3fa03b4270 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:36.904407 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-525807f6-4eb6-44c8-b9ae-bd3fa03b4270 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:36.904874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-525807f6-4eb6-44c8-b9ae-bd3fa03b4270 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:36.905642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-525807f6-4eb6-44c8-b9ae-bd3fa03b4270 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:36.906068 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-525807f6-4eb6-44c8-b9ae-bd3fa03b4270 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.048020 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-525807f6-4eb6-44c8-b9ae-bd3fa03b4270 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:37.057852 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-525807f6-4eb6-44c8-b9ae-bd3fa03b4270 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1508 microversion: 2.1 time: 0.166467 Feb 21 01:13:37.058535 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1249/2316] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:36 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:37.077618 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b07878cb-6fe2-4504-b36c-10eb7a7d505f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d9bb8b0-7576-4a4a-b3d4-020cc82c1cc3", "device": "/dev/sdb"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:37.078717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b07878cb-6fe2-4504-b36c-10eb7a7d505f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:37.085281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b07878cb-6fe2-4504-b36c-10eb7a7d505f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:37.085699 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b07878cb-6fe2-4504-b36c-10eb7a7d505f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.086471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b07878cb-6fe2-4504-b36c-10eb7a7d505f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:37.086961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b07878cb-6fe2-4504-b36c-10eb7a7d505f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.285847 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5bd00fd1-1b8d-44c3-b58f-d8ceba0c88b2 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:37.286690 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5bd00fd1-1b8d-44c3-b58f-d8ceba0c88b2 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:37.292957 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bd00fd1-1b8d-44c3-b58f-d8ceba0c88b2 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:37.293477 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bd00fd1-1b8d-44c3-b58f-d8ceba0c88b2 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.294317 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bd00fd1-1b8d-44c3-b58f-d8ceba0c88b2 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:37.294818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5bd00fd1-1b8d-44c3-b58f-d8ceba0c88b2 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:37.329781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b07878cb-6fe2-4504-b36c-10eb7a7d505f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "POST /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255609 Feb 21 01:13:37.330369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1068/2317] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 01:13:37 2022] POST /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:37.435781 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5bd00fd1-1b8d-44c3-b58f-d8ceba0c88b2 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:37.443456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5bd00fd1-1b8d-44c3-b58f-d8ceba0c88b2 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.161473 Feb 21 01:13:37.444146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1250/2318] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:37 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:13:38.461514 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-bfda48b6-a72e-43a8-a825-40df6b7583ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:38.462220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-bfda48b6-a72e-43a8-a825-40df6b7583ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:38.468961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfda48b6-a72e-43a8-a825-40df6b7583ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:38.469413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfda48b6-a72e-43a8-a825-40df6b7583ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:38.470195 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfda48b6-a72e-43a8-a825-40df6b7583ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:38.470649 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-bfda48b6-a72e-43a8-a825-40df6b7583ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:38.616324 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-bfda48b6-a72e-43a8-a825-40df6b7583ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:38.624281 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-bfda48b6-a72e-43a8-a825-40df6b7583ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.167442 Feb 21 01:13:38.624868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1069/2319] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:38 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:39.645921 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-30b55e73-5483-40af-bf52-7e1a4d48d9ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:39.646819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-30b55e73-5483-40af-bf52-7e1a4d48d9ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:39.657668 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30b55e73-5483-40af-bf52-7e1a4d48d9ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:39.658399 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30b55e73-5483-40af-bf52-7e1a4d48d9ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:39.659686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30b55e73-5483-40af-bf52-7e1a4d48d9ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:39.660460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-30b55e73-5483-40af-bf52-7e1a4d48d9ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:39.795556 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-30b55e73-5483-40af-bf52-7e1a4d48d9ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:39.802952 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-30b55e73-5483-40af-bf52-7e1a4d48d9ab tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.163708 Feb 21 01:13:39.803663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1251/2320] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:39 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:40.819606 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-35826d8d-d2e3-44b4-9016-4f43f82f0fd8 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:40.820202 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-35826d8d-d2e3-44b4-9016-4f43f82f0fd8 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:40.827050 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35826d8d-d2e3-44b4-9016-4f43f82f0fd8 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:40.827467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35826d8d-d2e3-44b4-9016-4f43f82f0fd8 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:40.828310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35826d8d-d2e3-44b4-9016-4f43f82f0fd8 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:40.828793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-35826d8d-d2e3-44b4-9016-4f43f82f0fd8 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:40.966678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-35826d8d-d2e3-44b4-9016-4f43f82f0fd8 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:40.974495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-35826d8d-d2e3-44b4-9016-4f43f82f0fd8 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.158621 Feb 21 01:13:40.975062 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1070/2321] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:40 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:42.000676 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-60acc020-e228-40ed-b768-63d4a0987f00 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:42.001692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-60acc020-e228-40ed-b768-63d4a0987f00 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:42.012326 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60acc020-e228-40ed-b768-63d4a0987f00 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:42.013120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60acc020-e228-40ed-b768-63d4a0987f00 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:42.014431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60acc020-e228-40ed-b768-63d4a0987f00 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:42.015140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-60acc020-e228-40ed-b768-63d4a0987f00 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:42.169032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-60acc020-e228-40ed-b768-63d4a0987f00 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:42.179711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-60acc020-e228-40ed-b768-63d4a0987f00 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.185370 Feb 21 01:13:42.180279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1252/2322] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:41 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:42.801498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-c0644fe0-95e2-4add-86c6-28bafac98c92 req-2345591b-583a-4262-b04f-1395bf53e4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b", "name": "network-vif-plugged", "status": "completed", "tag": "52d257b1-864f-4de7-be9c-2f18f4d64b47"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:42.803153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:42.803153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:13:42.810413 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-c0644fe0-95e2-4add-86c6-28bafac98c92 req-2345591b-583a-4262-b04f-1395bf53e4f2 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:42.810835 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-c0644fe0-95e2-4add-86c6-28bafac98c92 req-2345591b-583a-4262-b04f-1395bf53e4f2 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:42.821668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-c0644fe0-95e2-4add-86c6-28bafac98c92 req-2345591b-583a-4262-b04f-1395bf53e4f2 service nova] Creating event network-vif-plugged:52d257b1-864f-4de7-be9c-2f18f4d64b47 for instance feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b on hv-cinder-81322 Feb 21 01:13:42.826611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-c0644fe0-95e2-4add-86c6-28bafac98c92 req-2345591b-583a-4262-b04f-1395bf53e4f2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028802 Feb 21 01:13:42.827401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1071/2323] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:43.203038 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-a8249972-77d4-4101-a279-65842494d37e tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:43.203917 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-a8249972-77d4-4101-a279-65842494d37e tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:43.214514 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a8249972-77d4-4101-a279-65842494d37e tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:43.215247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a8249972-77d4-4101-a279-65842494d37e tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:43.216557 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a8249972-77d4-4101-a279-65842494d37e tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:43.217271 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-a8249972-77d4-4101-a279-65842494d37e tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:43.358270 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-a8249972-77d4-4101-a279-65842494d37e tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:43.369848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-a8249972-77d4-4101-a279-65842494d37e tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.172842 Feb 21 01:13:43.370597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1253/2324] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:43 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:44.392189 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c79389b4-7320-4f6d-b225-6bbfec6743e6 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:44.392884 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c79389b4-7320-4f6d-b225-6bbfec6743e6 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:44.399623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c79389b4-7320-4f6d-b225-6bbfec6743e6 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:44.400064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c79389b4-7320-4f6d-b225-6bbfec6743e6 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:44.400943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c79389b4-7320-4f6d-b225-6bbfec6743e6 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:44.401370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c79389b4-7320-4f6d-b225-6bbfec6743e6 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:44.549638 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-c79389b4-7320-4f6d-b225-6bbfec6743e6 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:44.557367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c79389b4-7320-4f6d-b225-6bbfec6743e6 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1313 microversion: 2.1 time: 0.170067 Feb 21 01:13:44.557939 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1072/2325] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:44 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:45.577851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0f29d96d-9418-4c76-a3cf-5c23e04d244a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:45.578913 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0f29d96d-9418-4c76-a3cf-5c23e04d244a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:45.589837 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f29d96d-9418-4c76-a3cf-5c23e04d244a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:45.590568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f29d96d-9418-4c76-a3cf-5c23e04d244a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:45.591858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f29d96d-9418-4c76-a3cf-5c23e04d244a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:45.592587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0f29d96d-9418-4c76-a3cf-5c23e04d244a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:45.737214 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0f29d96d-9418-4c76-a3cf-5c23e04d244a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:45.745085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0f29d96d-9418-4c76-a3cf-5c23e04d244a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1497 microversion: 2.1 time: 0.173533 Feb 21 01:13:45.745658 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1254/2326] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:45 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:50.227126 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-97c10ec4-76d8-4e24-b8a6-67e74d684f0f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:50.227670 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-97c10ec4-76d8-4e24-b8a6-67e74d684f0f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:50.237425 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97c10ec4-76d8-4e24-b8a6-67e74d684f0f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:50.238043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97c10ec4-76d8-4e24-b8a6-67e74d684f0f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:50.239182 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97c10ec4-76d8-4e24-b8a6-67e74d684f0f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:50.239796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-97c10ec4-76d8-4e24-b8a6-67e74d684f0f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:50.264302 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-97c10ec4-76d8-4e24-b8a6-67e74d684f0f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:13:50.343163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-97c10ec4-76d8-4e24-b8a6-67e74d684f0f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "DELETE /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 204 len: 0 microversion: 2.1 time: 0.121889 Feb 21 01:13:50.343729 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1073/2327] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:13:50 2022] DELETE /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:13:50.352589 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-5a534ebc-72f9-45e7-9eff-360591addbce tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:50.353216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-5a534ebc-72f9-45e7-9eff-360591addbce tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:50.359539 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a534ebc-72f9-45e7-9eff-360591addbce tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:50.359985 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a534ebc-72f9-45e7-9eff-360591addbce tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:50.360782 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a534ebc-72f9-45e7-9eff-360591addbce tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:50.361231 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-5a534ebc-72f9-45e7-9eff-360591addbce tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:50.492620 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-5a534ebc-72f9-45e7-9eff-360591addbce tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:50.510469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-5a534ebc-72f9-45e7-9eff-360591addbce tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1503 microversion: 2.1 time: 0.161122 Feb 21 01:13:50.511380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1255/2328] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:50 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:51.539933 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b471e7ae-56b7-4f05-a56f-8e901661533f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:51.540654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b471e7ae-56b7-4f05-a56f-8e901661533f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:51.547320 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b471e7ae-56b7-4f05-a56f-8e901661533f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:51.547751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b471e7ae-56b7-4f05-a56f-8e901661533f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:51.548555 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b471e7ae-56b7-4f05-a56f-8e901661533f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:51.548983 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b471e7ae-56b7-4f05-a56f-8e901661533f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:51.693668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b471e7ae-56b7-4f05-a56f-8e901661533f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:51.701894 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b471e7ae-56b7-4f05-a56f-8e901661533f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1503 microversion: 2.1 time: 0.168084 Feb 21 01:13:51.702467 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1074/2329] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:51 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:52.722738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d34b1fcf-8d16-49ed-b1a2-d0e0b7ac884d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:52.723378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d34b1fcf-8d16-49ed-b1a2-d0e0b7ac884d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:52.731371 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d34b1fcf-8d16-49ed-b1a2-d0e0b7ac884d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:52.731821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d34b1fcf-8d16-49ed-b1a2-d0e0b7ac884d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:52.732650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d34b1fcf-8d16-49ed-b1a2-d0e0b7ac884d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:52.733082 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d34b1fcf-8d16-49ed-b1a2-d0e0b7ac884d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:52.865796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d34b1fcf-8d16-49ed-b1a2-d0e0b7ac884d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:52.873828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d34b1fcf-8d16-49ed-b1a2-d0e0b7ac884d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1503 microversion: 2.1 time: 0.157131 Feb 21 01:13:52.874395 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1256/2330] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:52 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:53.895294 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-05c06308-85ba-4334-852b-951ceda15b44 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:53.896354 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-05c06308-85ba-4334-852b-951ceda15b44 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:53.904262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05c06308-85ba-4334-852b-951ceda15b44 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:53.904731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05c06308-85ba-4334-852b-951ceda15b44 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:53.905505 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05c06308-85ba-4334-852b-951ceda15b44 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:53.905928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05c06308-85ba-4334-852b-951ceda15b44 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:54.049427 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-05c06308-85ba-4334-852b-951ceda15b44 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:54.057153 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-05c06308-85ba-4334-852b-951ceda15b44 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1503 microversion: 2.1 time: 0.168416 Feb 21 01:13:54.057717 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1075/2331] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:53 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:55.078644 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2a161bcb-4bc5-4b26-8d2c-255ab0fea8cf tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:55.079586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2a161bcb-4bc5-4b26-8d2c-255ab0fea8cf tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:55.090632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a161bcb-4bc5-4b26-8d2c-255ab0fea8cf tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:55.091378 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a161bcb-4bc5-4b26-8d2c-255ab0fea8cf tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:55.092709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a161bcb-4bc5-4b26-8d2c-255ab0fea8cf tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:55.093478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2a161bcb-4bc5-4b26-8d2c-255ab0fea8cf tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:55.239713 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-2a161bcb-4bc5-4b26-8d2c-255ab0fea8cf tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:55.251980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2a161bcb-4bc5-4b26-8d2c-255ab0fea8cf tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1503 microversion: 2.1 time: 0.179561 Feb 21 01:13:55.252903 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1257/2332] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:55 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:56.274124 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4f0c9e13-288e-4524-b000-02e1b596568c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:56.274708 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4f0c9e13-288e-4524-b000-02e1b596568c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:56.281495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f0c9e13-288e-4524-b000-02e1b596568c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:56.281934 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f0c9e13-288e-4524-b000-02e1b596568c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:56.282711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f0c9e13-288e-4524-b000-02e1b596568c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:56.283129 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4f0c9e13-288e-4524-b000-02e1b596568c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:56.494186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-4f0c9e13-288e-4524-b000-02e1b596568c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:56.505823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4f0c9e13-288e-4524-b000-02e1b596568c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 200 len: 1503 microversion: 2.1 time: 0.237792 Feb 21 01:13:56.506588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1076/2333] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:56 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:56.833057 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-092793ec-31a9-4a85-b5b0-26e044fc3fe1 req-bd88e5f9-69a9-4b97-b63a-8f635cd035d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b", "name": "network-vif-deleted", "tag": "52d257b1-864f-4de7-be9c-2f18f4d64b47"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:56.834885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:13:56.834885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:13:56.843836 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-092793ec-31a9-4a85-b5b0-26e044fc3fe1 req-bd88e5f9-69a9-4b97-b63a-8f635cd035d2 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:56.844295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-092793ec-31a9-4a85-b5b0-26e044fc3fe1 req-bd88e5f9-69a9-4b97-b63a-8f635cd035d2 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:56.858929 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-092793ec-31a9-4a85-b5b0-26e044fc3fe1 req-bd88e5f9-69a9-4b97-b63a-8f635cd035d2 service nova] Creating event network-vif-deleted:52d257b1-864f-4de7-be9c-2f18f4d64b47 for instance feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b on hv-cinder-81322 Feb 21 01:13:56.864092 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-092793ec-31a9-4a85-b5b0-26e044fc3fe1 req-bd88e5f9-69a9-4b97-b63a-8f635cd035d2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Feb 21 01:13:56.864718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1258/2334] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:13:57.526997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:57.528121 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:57.538940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:57.539730 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:57.540547 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:57.540979 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:57.554322 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] HTTP exception thrown: Instance feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b could not be found. Feb 21 01:13:57.554943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Returning 404 to user: Instance feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:13:57.555765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2b928ffc-6850-4aa6-aa06-4e7c28943d21 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b" status: 404 len: 111 microversion: 2.1 time: 0.035038 Feb 21 01:13:57.556268 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1077/2335] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:57 2022] GET /compute/v2.1/servers/feb003fa-ad0d-4bb0-b3c9-f4e4c57baa1b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:13:57.606689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-838095356", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "993c65d5-6e44-4e76-85db-4181dda1f131"}]}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:13:57.663623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] validate_networks() for [('993c65d5-6e44-4e76-85db-4181dda1f131', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:13:58.011796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:13:58.012775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:13:58.013282 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:13:58.013871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:13:58.014494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:13:58.029951 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.030573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.031795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:58.032276 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:58.051353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Getting quotas for project 31af93e0c1fb451b8832a6683738d64c. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:13:58.055629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Getting quotas for user ab0b10226a8046099231bcd64e5fea9c and project 31af93e0c1fb451b8832a6683738d64c. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:13:58.067234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:13:58.069659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:13:58.120697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-9dad9050-3bf7-4a26-9c2e-6d734314db91 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517936 Feb 21 01:13:58.121356 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1259/2336] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 01:13:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:13:58.131799 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2ca2acbd-10bc-4092-8955-55d7d8c92e06 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:58.132426 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2ca2acbd-10bc-4092-8955-55d7d8c92e06 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:58.187665 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2ca2acbd-10bc-4092-8955-55d7d8c92e06 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:58.194154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2ca2acbd-10bc-4092-8955-55d7d8c92e06 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1213 microversion: 2.1 time: 0.066258 Feb 21 01:13:58.194715 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1078/2337] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:58 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:59.210876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-024738e5-1d31-4d6b-847e-0c8299469045 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:59.212411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-024738e5-1d31-4d6b-847e-0c8299469045 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:59.219343 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-024738e5-1d31-4d6b-847e-0c8299469045 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:59.220120 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-024738e5-1d31-4d6b-847e-0c8299469045 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.223643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-024738e5-1d31-4d6b-847e-0c8299469045 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:59.224084 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-024738e5-1d31-4d6b-847e-0c8299469045 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.285216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-024738e5-1d31-4d6b-847e-0c8299469045 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:13:59.292580 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-024738e5-1d31-4d6b-847e-0c8299469045 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1271 microversion: 2.1 time: 0.085309 Feb 21 01:13:59.293149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1260/2338] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:13:59 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:13:59.775076 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4a460459-2bb3-4dbd-8a9a-9b1ddc8d67f8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:13:59.775626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4a460459-2bb3-4dbd-8a9a-9b1ddc8d67f8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:13:59.785403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a460459-2bb3-4dbd-8a9a-9b1ddc8d67f8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:59.785945 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a460459-2bb3-4dbd-8a9a-9b1ddc8d67f8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.786794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a460459-2bb3-4dbd-8a9a-9b1ddc8d67f8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:13:59.787331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a460459-2bb3-4dbd-8a9a-9b1ddc8d67f8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:13:59.866036 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-4a460459-2bb3-4dbd-8a9a-9b1ddc8d67f8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'services' on Instance uuid 9e068400-0ef6-4274-b849-e244399308de {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:13:59.937694 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4a460459-2bb3-4dbd-8a9a-9b1ddc8d67f8 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de/os-volume_attachments/0d9bb8b0-7576-4a4a-b3d4-020cc82c1cc3" status: 202 len: 0 microversion: 2.1 time: 0.166283 Feb 21 01:13:59.938247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1079/2339] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 01:13:59 2022] DELETE /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de/os-volume_attachments/0d9bb8b0-7576-4a4a-b3d4-020cc82c1cc3 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:14:00.309693 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fdefcaef-8f8f-430e-b13d-3c8c4ac7d057 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:00.310494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fdefcaef-8f8f-430e-b13d-3c8c4ac7d057 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:00.317434 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdefcaef-8f8f-430e-b13d-3c8c4ac7d057 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.317881 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdefcaef-8f8f-430e-b13d-3c8c4ac7d057 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:00.318675 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdefcaef-8f8f-430e-b13d-3c8c4ac7d057 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.319088 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-fdefcaef-8f8f-430e-b13d-3c8c4ac7d057 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:00.327393 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-6c05bee5-c0a4-4651-bccc-bf39f4069bdc req-3c89034e-7268-48c4-b7b6-59adb1b2747b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a606700-0765-4b8d-ae07-a77179eb7f3a", "tag": "5311ef8d-4e23-40af-ae45-d3d2b7600e21"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:14:00.328946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:00.328946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:14:00.336422 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-6c05bee5-c0a4-4651-bccc-bf39f4069bdc req-3c89034e-7268-48c4-b7b6-59adb1b2747b service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:00.337107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-6c05bee5-c0a4-4651-bccc-bf39f4069bdc req-3c89034e-7268-48c4-b7b6-59adb1b2747b service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:00.348171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-6c05bee5-c0a4-4651-bccc-bf39f4069bdc req-3c89034e-7268-48c4-b7b6-59adb1b2747b service nova] Creating event network-changed:5311ef8d-4e23-40af-ae45-d3d2b7600e21 for instance 2a606700-0765-4b8d-ae07-a77179eb7f3a on hv-cinder-81322 Feb 21 01:14:00.353653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-6c05bee5-c0a4-4651-bccc-bf39f4069bdc req-3c89034e-7268-48c4-b7b6-59adb1b2747b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029961 Feb 21 01:14:00.354231 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1080/2340] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:14:00.468572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fdefcaef-8f8f-430e-b13d-3c8c4ac7d057 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:00.476069 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fdefcaef-8f8f-430e-b13d-3c8c4ac7d057 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.170175 Feb 21 01:14:00.476768 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1261/2341] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:00 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:01.048710 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a8c5965c-51fb-4984-8727-3ae09a720ff0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:01.049308 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a8c5965c-51fb-4984-8727-3ae09a720ff0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:01.055536 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8c5965c-51fb-4984-8727-3ae09a720ff0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.055993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8c5965c-51fb-4984-8727-3ae09a720ff0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.056805 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8c5965c-51fb-4984-8727-3ae09a720ff0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.057239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a8c5965c-51fb-4984-8727-3ae09a720ff0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.083950 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a8c5965c-51fb-4984-8727-3ae09a720ff0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:14:01.167143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a8c5965c-51fb-4984-8727-3ae09a720ff0 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 204 len: 0 microversion: 2.1 time: 0.122728 Feb 21 01:14:01.167761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1081/2342] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:14:01 2022] DELETE /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:14:01.176269 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8707c1ca-0e3b-4f9a-bc1f-3ae3d019c550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:01.176918 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8707c1ca-0e3b-4f9a-bc1f-3ae3d019c550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:01.182969 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8707c1ca-0e3b-4f9a-bc1f-3ae3d019c550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.183597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8707c1ca-0e3b-4f9a-bc1f-3ae3d019c550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.184410 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8707c1ca-0e3b-4f9a-bc1f-3ae3d019c550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.184839 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8707c1ca-0e3b-4f9a-bc1f-3ae3d019c550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.319436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8707c1ca-0e3b-4f9a-bc1f-3ae3d019c550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:01.327061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8707c1ca-0e3b-4f9a-bc1f-3ae3d019c550 tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1514 microversion: 2.1 time: 0.154591 Feb 21 01:14:01.327630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1262/2343] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:01 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:01.496347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b7796d6f-6e57-4172-b7b7-490c7dfe738f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:01.497106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b7796d6f-6e57-4172-b7b7-490c7dfe738f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:01.503082 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7796d6f-6e57-4172-b7b7-490c7dfe738f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.503553 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7796d6f-6e57-4172-b7b7-490c7dfe738f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.504319 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7796d6f-6e57-4172-b7b7-490c7dfe738f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:01.504786 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b7796d6f-6e57-4172-b7b7-490c7dfe738f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:01.642814 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b7796d6f-6e57-4172-b7b7-490c7dfe738f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:01.650883 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b7796d6f-6e57-4172-b7b7-490c7dfe738f tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.160190 Feb 21 01:14:01.651460 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1082/2344] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:01 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:02.347202 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-dac843a1-f0c7-4381-a599-76796d6aed3f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:02.348142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-dac843a1-f0c7-4381-a599-76796d6aed3f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:02.359132 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dac843a1-f0c7-4381-a599-76796d6aed3f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.359871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dac843a1-f0c7-4381-a599-76796d6aed3f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.361224 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dac843a1-f0c7-4381-a599-76796d6aed3f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.361958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-dac843a1-f0c7-4381-a599-76796d6aed3f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.523073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-dac843a1-f0c7-4381-a599-76796d6aed3f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:02.531700 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-dac843a1-f0c7-4381-a599-76796d6aed3f tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1514 microversion: 2.1 time: 0.190634 Feb 21 01:14:02.532366 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1263/2345] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:02 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:02.671110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dc279144-9e63-4973-adc6-fc14387ea285 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:02.671966 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dc279144-9e63-4973-adc6-fc14387ea285 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:02.682666 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc279144-9e63-4973-adc6-fc14387ea285 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.683404 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc279144-9e63-4973-adc6-fc14387ea285 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.684744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc279144-9e63-4973-adc6-fc14387ea285 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:02.685458 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dc279144-9e63-4973-adc6-fc14387ea285 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:02.828781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-dc279144-9e63-4973-adc6-fc14387ea285 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:02.838262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dc279144-9e63-4973-adc6-fc14387ea285 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.173634 Feb 21 01:14:02.841061 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1083/2346] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:02 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:03.551028 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b3d48973-fa68-4e6c-9d50-57254562dbbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:03.551666 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b3d48973-fa68-4e6c-9d50-57254562dbbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:03.558982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3d48973-fa68-4e6c-9d50-57254562dbbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.559404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3d48973-fa68-4e6c-9d50-57254562dbbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.560198 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3d48973-fa68-4e6c-9d50-57254562dbbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.560663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b3d48973-fa68-4e6c-9d50-57254562dbbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.704096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b3d48973-fa68-4e6c-9d50-57254562dbbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:03.712953 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b3d48973-fa68-4e6c-9d50-57254562dbbc tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1514 microversion: 2.1 time: 0.166821 Feb 21 01:14:03.713538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1264/2347] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:03 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:03.859576 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-07a02756-6bfe-4ae7-8fed-4de81f8be5f5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:03.860174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-07a02756-6bfe-4ae7-8fed-4de81f8be5f5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:03.866873 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07a02756-6bfe-4ae7-8fed-4de81f8be5f5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.867323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07a02756-6bfe-4ae7-8fed-4de81f8be5f5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:03.868159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07a02756-6bfe-4ae7-8fed-4de81f8be5f5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:03.868634 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-07a02756-6bfe-4ae7-8fed-4de81f8be5f5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.106758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-07a02756-6bfe-4ae7-8fed-4de81f8be5f5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:04.114430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-07a02756-6bfe-4ae7-8fed-4de81f8be5f5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.258577 Feb 21 01:14:04.115003 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1084/2348] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:03 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:04.261819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-0d9e4a0f-94a6-45be-89fe-57a3eef0a9e8 req-3e9caf76-ac04-47cd-93a1-b7a1a7932f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e068400-0ef6-4274-b849-e244399308de", "name": "network-vif-deleted", "tag": "7eacbd89-325e-42bd-a90b-b2bd5e4b483f"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:14:04.263485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:04.263485 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:14:04.271942 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0d9e4a0f-94a6-45be-89fe-57a3eef0a9e8 req-3e9caf76-ac04-47cd-93a1-b7a1a7932f31 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.272936 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0d9e4a0f-94a6-45be-89fe-57a3eef0a9e8 req-3e9caf76-ac04-47cd-93a1-b7a1a7932f31 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.284807 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-0d9e4a0f-94a6-45be-89fe-57a3eef0a9e8 req-3e9caf76-ac04-47cd-93a1-b7a1a7932f31 service nova] Creating event network-vif-deleted:7eacbd89-325e-42bd-a90b-b2bd5e4b483f for instance 9e068400-0ef6-4274-b849-e244399308de on hv-cinder-81322 Feb 21 01:14:04.290654 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-0d9e4a0f-94a6-45be-89fe-57a3eef0a9e8 req-3e9caf76-ac04-47cd-93a1-b7a1a7932f31 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032643 Feb 21 01:14:04.291256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1265/2349] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:04.730165 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:04.731010 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:04.737733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.738272 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.739235 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.739953 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.775315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:04.775837 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:04.776218 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lazy-loading 'fault' on Instance uuid 9e068400-0ef6-4274-b849-e244399308de {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:14:04.815325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e624bab4554a3fa8e1a028a81b6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57be6173077b4dedaa6514ff1841b515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:04.822111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-675c42b4-af72-47e2-9471-b312d73156fe tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 200 len: 1309 microversion: 2.1 time: 0.096659 Feb 21 01:14:04.822678 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1085/2350] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:04 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:05.136116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-42fa8047-ec3f-40a6-af5f-e860fc9ca5a7 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:05.137216 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-42fa8047-ec3f-40a6-af5f-e860fc9ca5a7 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:05.148629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42fa8047-ec3f-40a6-af5f-e860fc9ca5a7 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:05.149282 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42fa8047-ec3f-40a6-af5f-e860fc9ca5a7 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.150061 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42fa8047-ec3f-40a6-af5f-e860fc9ca5a7 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:05.150491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42fa8047-ec3f-40a6-af5f-e860fc9ca5a7 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.306016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-42fa8047-ec3f-40a6-af5f-e860fc9ca5a7 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:05.313864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-42fa8047-ec3f-40a6-af5f-e860fc9ca5a7 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.184874 Feb 21 01:14:05.314484 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1266/2351] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:05 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:05.843012 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:05.843846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] [instance: 9e068400-0ef6-4274-b849-e244399308de] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:05.854492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:05.855242 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.856543 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:05.857258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:05.874834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] HTTP exception thrown: Instance 9e068400-0ef6-4274-b849-e244399308de could not be found. Feb 21 01:14:05.875409 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] Returning 404 to user: Instance 9e068400-0ef6-4274-b849-e244399308de could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:14:05.876220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-dbfb82a9-0d0a-4345-86a2-6a482adb564a tempest-VolumesSnapshotTestJSON-1384952816 tempest-VolumesSnapshotTestJSON-1384952816-project] 10.222.0.72 "GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de" status: 404 len: 111 microversion: 2.1 time: 0.039740 Feb 21 01:14:05.876779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1086/2352] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:05 2022] GET /compute/v2.1/servers/9e068400-0ef6-4274-b849-e244399308de => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:06.334796 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-162e43d9-a0d2-4daf-b636-912f34fb0590 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:06.335732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-162e43d9-a0d2-4daf-b636-912f34fb0590 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:06.346855 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-162e43d9-a0d2-4daf-b636-912f34fb0590 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.347463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-162e43d9-a0d2-4daf-b636-912f34fb0590 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.348774 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-162e43d9-a0d2-4daf-b636-912f34fb0590 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.349483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-162e43d9-a0d2-4daf-b636-912f34fb0590 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.489018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-162e43d9-a0d2-4daf-b636-912f34fb0590 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:06.496766 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-162e43d9-a0d2-4daf-b636-912f34fb0590 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.168127 Feb 21 01:14:06.497311 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1267/2353] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:06 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:06.930258 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-967c44c6-c37f-4eb0-a208-1b82bb09acfb req-74f44423-87d5-4c6e-a214-720fe15c9ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a606700-0765-4b8d-ae07-a77179eb7f3a", "name": "network-vif-plugged", "status": "completed", "tag": "5311ef8d-4e23-40af-ae45-d3d2b7600e21"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:14:06.931982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:06.931982 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:14:06.939885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-967c44c6-c37f-4eb0-a208-1b82bb09acfb req-74f44423-87d5-4c6e-a214-720fe15c9ddb service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:06.940280 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-967c44c6-c37f-4eb0-a208-1b82bb09acfb req-74f44423-87d5-4c6e-a214-720fe15c9ddb service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:06.951718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-967c44c6-c37f-4eb0-a208-1b82bb09acfb req-74f44423-87d5-4c6e-a214-720fe15c9ddb service nova] Creating event network-vif-plugged:5311ef8d-4e23-40af-ae45-d3d2b7600e21 for instance 2a606700-0765-4b8d-ae07-a77179eb7f3a on hv-cinder-81322 Feb 21 01:14:06.956711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-967c44c6-c37f-4eb0-a208-1b82bb09acfb req-74f44423-87d5-4c6e-a214-720fe15c9ddb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030385 Feb 21 01:14:06.957348 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1087/2354] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:07.521895 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-933b5dba-c94e-4f16-8473-0a9729388f1c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:07.522794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-933b5dba-c94e-4f16-8473-0a9729388f1c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:07.530139 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-933b5dba-c94e-4f16-8473-0a9729388f1c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:07.530590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-933b5dba-c94e-4f16-8473-0a9729388f1c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:07.531374 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-933b5dba-c94e-4f16-8473-0a9729388f1c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:07.531804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-933b5dba-c94e-4f16-8473-0a9729388f1c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:07.682769 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-933b5dba-c94e-4f16-8473-0a9729388f1c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:07.693972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-933b5dba-c94e-4f16-8473-0a9729388f1c tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.178539 Feb 21 01:14:07.694742 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1268/2355] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:07 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:08.717024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1affa64b-7cc8-4184-8fab-c8d4f210d3db tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:08.718311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1affa64b-7cc8-4184-8fab-c8d4f210d3db tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:08.728131 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1affa64b-7cc8-4184-8fab-c8d4f210d3db tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:08.728639 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1affa64b-7cc8-4184-8fab-c8d4f210d3db tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:08.729445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1affa64b-7cc8-4184-8fab-c8d4f210d3db tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:08.729846 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1affa64b-7cc8-4184-8fab-c8d4f210d3db tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:08.870520 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1affa64b-7cc8-4184-8fab-c8d4f210d3db tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:08.878094 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1affa64b-7cc8-4184-8fab-c8d4f210d3db tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.168736 Feb 21 01:14:08.878640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1088/2356] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:08 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:09.899302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6b1306bc-858e-4dc8-a8a2-4e90ceeb8bd1 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:09.899870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6b1306bc-858e-4dc8-a8a2-4e90ceeb8bd1 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:09.906785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b1306bc-858e-4dc8-a8a2-4e90ceeb8bd1 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:09.907227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b1306bc-858e-4dc8-a8a2-4e90ceeb8bd1 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:09.908060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b1306bc-858e-4dc8-a8a2-4e90ceeb8bd1 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:09.908417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b1306bc-858e-4dc8-a8a2-4e90ceeb8bd1 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:10.052637 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6b1306bc-858e-4dc8-a8a2-4e90ceeb8bd1 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:10.060733 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6b1306bc-858e-4dc8-a8a2-4e90ceeb8bd1 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.167584 Feb 21 01:14:10.061688 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1269/2357] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:09 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:11.082946 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-8256c31e-547e-49b2-bbe2-605e3ba71095 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:11.083667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-8256c31e-547e-49b2-bbe2-605e3ba71095 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:11.091118 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8256c31e-547e-49b2-bbe2-605e3ba71095 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:11.091570 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8256c31e-547e-49b2-bbe2-605e3ba71095 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:11.092349 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8256c31e-547e-49b2-bbe2-605e3ba71095 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:11.092810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-8256c31e-547e-49b2-bbe2-605e3ba71095 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:11.231293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-8256c31e-547e-49b2-bbe2-605e3ba71095 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:11.238775 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-8256c31e-547e-49b2-bbe2-605e3ba71095 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.160899 Feb 21 01:14:11.239341 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1089/2358] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:11 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:12.259191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-147efdfc-22dd-4025-b7e5-6bf5a5e4a18d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:12.260254 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-147efdfc-22dd-4025-b7e5-6bf5a5e4a18d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:12.271332 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-147efdfc-22dd-4025-b7e5-6bf5a5e4a18d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:12.271979 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-147efdfc-22dd-4025-b7e5-6bf5a5e4a18d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:12.273310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-147efdfc-22dd-4025-b7e5-6bf5a5e4a18d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:12.274151 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-147efdfc-22dd-4025-b7e5-6bf5a5e4a18d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:12.421911 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-147efdfc-22dd-4025-b7e5-6bf5a5e4a18d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:12.429466 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-147efdfc-22dd-4025-b7e5-6bf5a5e4a18d tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1313 microversion: 2.1 time: 0.176770 Feb 21 01:14:12.430055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1270/2359] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:12 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:13.450435 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e8792330-cf72-4d63-80f1-9ba24ced913a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:13.451480 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e8792330-cf72-4d63-80f1-9ba24ced913a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:13.461943 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8792330-cf72-4d63-80f1-9ba24ced913a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:13.462392 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8792330-cf72-4d63-80f1-9ba24ced913a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:13.463170 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8792330-cf72-4d63-80f1-9ba24ced913a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:13.463611 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e8792330-cf72-4d63-80f1-9ba24ced913a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:13.746400 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e8792330-cf72-4d63-80f1-9ba24ced913a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:13.753855 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e8792330-cf72-4d63-80f1-9ba24ced913a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1498 microversion: 2.1 time: 0.310006 Feb 21 01:14:13.754516 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1090/2360] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:13 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1498 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:14.312714 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2b8159f4-e0e3-4ce5-b206-dd456857f240 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:14.313231 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2b8159f4-e0e3-4ce5-b206-dd456857f240 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:14.319649 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b8159f4-e0e3-4ce5-b206-dd456857f240 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.320116 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b8159f4-e0e3-4ce5-b206-dd456857f240 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.321641 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b8159f4-e0e3-4ce5-b206-dd456857f240 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.321827 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2b8159f4-e0e3-4ce5-b206-dd456857f240 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.348719 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2b8159f4-e0e3-4ce5-b206-dd456857f240 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Going to try to terminate instance {{(pid=123098) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:14:14.425536 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2b8159f4-e0e3-4ce5-b206-dd456857f240 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 204 len: 0 microversion: 2.1 time: 0.116248 Feb 21 01:14:14.426125 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1271/2361] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:14:14 2022] DELETE /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:14:14.434494 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-272e655a-62f4-43c1-bdfa-7f6f6dff7981 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:14.435113 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-272e655a-62f4-43c1-bdfa-7f6f6dff7981 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:14.441027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-272e655a-62f4-43c1-bdfa-7f6f6dff7981 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.441463 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-272e655a-62f4-43c1-bdfa-7f6f6dff7981 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.442256 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-272e655a-62f4-43c1-bdfa-7f6f6dff7981 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:14.442662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-272e655a-62f4-43c1-bdfa-7f6f6dff7981 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:14.581887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-272e655a-62f4-43c1-bdfa-7f6f6dff7981 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:14.593563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-272e655a-62f4-43c1-bdfa-7f6f6dff7981 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1504 microversion: 2.1 time: 0.162594 Feb 21 01:14:14.594300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1091/2362] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:14 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:15.618629 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4437681e-ea1e-452e-befb-7e0ed935e73a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:15.619436 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4437681e-ea1e-452e-befb-7e0ed935e73a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:15.627371 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4437681e-ea1e-452e-befb-7e0ed935e73a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:15.627890 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4437681e-ea1e-452e-befb-7e0ed935e73a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:15.628868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4437681e-ea1e-452e-befb-7e0ed935e73a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:15.629373 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4437681e-ea1e-452e-befb-7e0ed935e73a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:15.819404 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4437681e-ea1e-452e-befb-7e0ed935e73a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:15.827222 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4437681e-ea1e-452e-befb-7e0ed935e73a tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1504 microversion: 2.1 time: 0.215542 Feb 21 01:14:15.827792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1272/2363] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:15 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:16.680745 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-a53ff4e1-f48f-41c5-a4b7-4bd7641ce3d4 req-474038d9-822a-445c-b55a-764c28d0bfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a606700-0765-4b8d-ae07-a77179eb7f3a", "name": "network-vif-deleted", "tag": "5311ef8d-4e23-40af-ae45-d3d2b7600e21"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:14:16.682538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:14:16.682538 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:14:16.691636 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-a53ff4e1-f48f-41c5-a4b7-4bd7641ce3d4 req-474038d9-822a-445c-b55a-764c28d0bfa6 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.692181 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-a53ff4e1-f48f-41c5-a4b7-4bd7641ce3d4 req-474038d9-822a-445c-b55a-764c28d0bfa6 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.705041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-a53ff4e1-f48f-41c5-a4b7-4bd7641ce3d4 req-474038d9-822a-445c-b55a-764c28d0bfa6 service nova] Creating event network-vif-deleted:5311ef8d-4e23-40af-ae45-d3d2b7600e21 for instance 2a606700-0765-4b8d-ae07-a77179eb7f3a on hv-cinder-81322 Feb 21 01:14:16.710115 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-a53ff4e1-f48f-41c5-a4b7-4bd7641ce3d4 req-474038d9-822a-445c-b55a-764c28d0bfa6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033255 Feb 21 01:14:16.710718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1092/2364] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:14:16.847250 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:16.848155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:16.856339 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.856818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.857586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.858002 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.888442 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:16.888893 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:16.889330 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lazy-loading 'fault' on Instance uuid 2a606700-0765-4b8d-ae07-a77179eb7f3a {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:14:16.931070 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0b10226a8046099231bcd64e5fea9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af93e0c1fb451b8832a6683738d64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:14:16.938617 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f6ff1167-f60a-459d-a95b-73b8320ee2eb tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 200 len: 1303 microversion: 2.1 time: 0.097358 Feb 21 01:14:16.939190 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1273/2365] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:16 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:14:17.961544 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:14:17.962692 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] [instance: 2a606700-0765-4b8d-ae07-a77179eb7f3a] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:14:17.970106 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:17.970564 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:17.971420 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:14:17.971889 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:14:17.986562 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] HTTP exception thrown: Instance 2a606700-0765-4b8d-ae07-a77179eb7f3a could not be found. Feb 21 01:14:17.987207 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] Returning 404 to user: Instance 2a606700-0765-4b8d-ae07-a77179eb7f3a could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:14:17.988102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1e2d8415-5122-4aed-8bfd-15c88fbe37a5 tempest-VolumesActionsTest-1790328465 tempest-VolumesActionsTest-1790328465-project] 10.222.0.72 "GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a" status: 404 len: 111 microversion: 2.1 time: 0.034227 Feb 21 01:14:17.988712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1093/2366] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:14:17 2022] GET /compute/v2.1/servers/2a606700-0765-4b8d-ae07-a77179eb7f3a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:14:59.739108 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:14:59.739836 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:15:30.011858 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83a3ccc8-28fa-4dd3-8fb3-cd41f994c861] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 21 01:15:30.015593 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-842189750", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:15:30.064379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] validate_networks() for None {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:15:30.327906 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:15:30.328550 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:15:30.329273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:15:30.329934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:15:30.330527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:15:30.340696 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:30.341140 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:30.341949 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:30.342358 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:30.358488 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Getting quotas for project 5da1df67d9ea4300b553b80ef7cbb0a4. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:15:30.362533 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Getting quotas for user 3745a32e4a2f4cf1a1dcf15d5e11cdbd and project 5da1df67d9ea4300b553b80ef7cbb0a4. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:15:30.372996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:15:30.375267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:15:30.429149 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-53645685-1bb4-4c98-b664-63b09602d406 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.419318 Feb 21 01:15:30.429788 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1274/2367] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 01:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:15:30.440609 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-2016d93e-e538-4bb9-ba68-34ebbb13e4b0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:30.441222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-2016d93e-e538-4bb9-ba68-34ebbb13e4b0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:30.496300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-2016d93e-e538-4bb9-ba68-34ebbb13e4b0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:30.503127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-2016d93e-e538-4bb9-ba68-34ebbb13e4b0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1214 microversion: 2.1 time: 0.067258 Feb 21 01:15:30.503686 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1094/2368] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:30 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:31.521244 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7bc352e6-588d-46b7-9942-530ad46b5e08 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:31.522563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7bc352e6-588d-46b7-9942-530ad46b5e08 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:31.532309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bc352e6-588d-46b7-9942-530ad46b5e08 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:31.532767 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bc352e6-588d-46b7-9942-530ad46b5e08 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:31.533549 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bc352e6-588d-46b7-9942-530ad46b5e08 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:31.533973 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7bc352e6-588d-46b7-9942-530ad46b5e08 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:31.539518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] [83a3ccc8-28fa-4dd3-8fb3-cd41f994c861] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 40516. Feb 21 01:15:31.866217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7bc352e6-588d-46b7-9942-530ad46b5e08 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:31.874567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7bc352e6-588d-46b7-9942-530ad46b5e08 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1284 microversion: 2.1 time: 0.357876 Feb 21 01:15:31.875357 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1275/2369] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:31 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:32.891465 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fcb27197-e33b-451f-83cc-a85d588b107a tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:32.892059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fcb27197-e33b-451f-83cc-a85d588b107a tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:32.900132 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fcb27197-e33b-451f-83cc-a85d588b107a tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:32.900641 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fcb27197-e33b-451f-83cc-a85d588b107a tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:32.901417 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fcb27197-e33b-451f-83cc-a85d588b107a tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:32.901847 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fcb27197-e33b-451f-83cc-a85d588b107a tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:33.113809 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fcb27197-e33b-451f-83cc-a85d588b107a tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:33.124179 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fcb27197-e33b-451f-83cc-a85d588b107a tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1314 microversion: 2.1 time: 0.236672 Feb 21 01:15:33.133654 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1095/2370] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:32 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:33.162163 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-0fd05bc6-dbdb-43bd-b2ec-b250571676f9 req-524664ad-d72f-4a73-a6f1-20f556e6aee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff3689c5-c50a-4ccc-bd3a-f0731f2042fd", "tag": "16ba8e07-d908-4318-8fc6-b59ac3121ac5"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:15:33.164130 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:15:33.164130 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:15:33.176501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0fd05bc6-dbdb-43bd-b2ec-b250571676f9 req-524664ad-d72f-4a73-a6f1-20f556e6aee4 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:33.177324 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0fd05bc6-dbdb-43bd-b2ec-b250571676f9 req-524664ad-d72f-4a73-a6f1-20f556e6aee4 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:33.198327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-0fd05bc6-dbdb-43bd-b2ec-b250571676f9 req-524664ad-d72f-4a73-a6f1-20f556e6aee4 service nova] Creating event network-changed:16ba8e07-d908-4318-8fc6-b59ac3121ac5 for instance ff3689c5-c50a-4ccc-bd3a-f0731f2042fd on hv-cinder-81322 Feb 21 01:15:33.203598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-0fd05bc6-dbdb-43bd-b2ec-b250571676f9 req-524664ad-d72f-4a73-a6f1-20f556e6aee4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047019 Feb 21 01:15:33.204756 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1276/2371] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:34.144054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e5542cda-4c8b-4809-b6b8-64346b268ef3 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:34.144755 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e5542cda-4c8b-4809-b6b8-64346b268ef3 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:34.153174 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e5542cda-4c8b-4809-b6b8-64346b268ef3 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:34.153829 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e5542cda-4c8b-4809-b6b8-64346b268ef3 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:34.155011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e5542cda-4c8b-4809-b6b8-64346b268ef3 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:34.155585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e5542cda-4c8b-4809-b6b8-64346b268ef3 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:34.292601 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e5542cda-4c8b-4809-b6b8-64346b268ef3 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:34.300289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e5542cda-4c8b-4809-b6b8-64346b268ef3 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1314 microversion: 2.1 time: 0.162464 Feb 21 01:15:34.300996 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1096/2372] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:34 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:35.317659 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6e43dbef-663f-4ad8-82c2-9ea12f7fac6b tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:35.318348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6e43dbef-663f-4ad8-82c2-9ea12f7fac6b tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:35.325885 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e43dbef-663f-4ad8-82c2-9ea12f7fac6b tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:35.326318 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e43dbef-663f-4ad8-82c2-9ea12f7fac6b tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:35.327148 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e43dbef-663f-4ad8-82c2-9ea12f7fac6b tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:35.327573 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6e43dbef-663f-4ad8-82c2-9ea12f7fac6b tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:35.470307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-6e43dbef-663f-4ad8-82c2-9ea12f7fac6b tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:35.478868 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6e43dbef-663f-4ad8-82c2-9ea12f7fac6b tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1314 microversion: 2.1 time: 0.165259 Feb 21 01:15:35.479365 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1277/2373] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:35 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:36.499512 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3a60d95c-e5a5-44b9-b5d5-a882390cc682 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:36.500484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3a60d95c-e5a5-44b9-b5d5-a882390cc682 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:36.511224 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a60d95c-e5a5-44b9-b5d5-a882390cc682 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:36.511965 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a60d95c-e5a5-44b9-b5d5-a882390cc682 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:36.513314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a60d95c-e5a5-44b9-b5d5-a882390cc682 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:36.514424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3a60d95c-e5a5-44b9-b5d5-a882390cc682 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:36.652304 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3a60d95c-e5a5-44b9-b5d5-a882390cc682 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:36.663264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3a60d95c-e5a5-44b9-b5d5-a882390cc682 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1314 microversion: 2.1 time: 0.169743 Feb 21 01:15:36.663997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1097/2374] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:36 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:37.689403 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8b8f58af-2236-4f29-b138-65da10445bc7 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:37.690361 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8b8f58af-2236-4f29-b138-65da10445bc7 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:37.698243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b8f58af-2236-4f29-b138-65da10445bc7 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:37.698572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b8f58af-2236-4f29-b138-65da10445bc7 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:37.700785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b8f58af-2236-4f29-b138-65da10445bc7 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:37.700785 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b8f58af-2236-4f29-b138-65da10445bc7 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:37.838596 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8b8f58af-2236-4f29-b138-65da10445bc7 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:37.849960 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8b8f58af-2236-4f29-b138-65da10445bc7 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1314 microversion: 2.1 time: 0.166849 Feb 21 01:15:37.850588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1278/2375] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:37 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:38.875211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0b802221-4f02-40ba-959c-4cd2c9f69bd0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:38.876190 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0b802221-4f02-40ba-959c-4cd2c9f69bd0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:38.886986 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b802221-4f02-40ba-959c-4cd2c9f69bd0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:38.887731 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b802221-4f02-40ba-959c-4cd2c9f69bd0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:38.889462 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b802221-4f02-40ba-959c-4cd2c9f69bd0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:38.890178 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0b802221-4f02-40ba-959c-4cd2c9f69bd0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:39.027808 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-0b802221-4f02-40ba-959c-4cd2c9f69bd0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:39.035251 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0b802221-4f02-40ba-959c-4cd2c9f69bd0 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1314 microversion: 2.1 time: 0.166248 Feb 21 01:15:39.036027 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1098/2376] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:38 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:39.495170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-0bccba52-437e-497b-a78d-1fded41b996e req-7e55284d-83cd-4d93-bfb4-d5d07d4deafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3689c5-c50a-4ccc-bd3a-f0731f2042fd", "name": "network-vif-plugged", "status": "completed", "tag": "16ba8e07-d908-4318-8fc6-b59ac3121ac5"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:15:39.496795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:15:39.496795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:15:39.503791 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0bccba52-437e-497b-a78d-1fded41b996e req-7e55284d-83cd-4d93-bfb4-d5d07d4deafc service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:39.504217 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0bccba52-437e-497b-a78d-1fded41b996e req-7e55284d-83cd-4d93-bfb4-d5d07d4deafc service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:39.517146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-0bccba52-437e-497b-a78d-1fded41b996e req-7e55284d-83cd-4d93-bfb4-d5d07d4deafc service nova] Creating event network-vif-plugged:16ba8e07-d908-4318-8fc6-b59ac3121ac5 for instance ff3689c5-c50a-4ccc-bd3a-f0731f2042fd on hv-cinder-81322 Feb 21 01:15:39.522283 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-0bccba52-437e-497b-a78d-1fded41b996e req-7e55284d-83cd-4d93-bfb4-d5d07d4deafc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147303 Feb 21 01:15:39.522859 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1279/2377] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:40.053671 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-459669de-6b6d-4336-b266-0aafa1ef2012 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:40.054270 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-459669de-6b6d-4336-b266-0aafa1ef2012 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:40.061175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-459669de-6b6d-4336-b266-0aafa1ef2012 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:40.061630 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-459669de-6b6d-4336-b266-0aafa1ef2012 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:40.062452 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-459669de-6b6d-4336-b266-0aafa1ef2012 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:40.062887 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-459669de-6b6d-4336-b266-0aafa1ef2012 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:40.208312 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-459669de-6b6d-4336-b266-0aafa1ef2012 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:40.216435 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-459669de-6b6d-4336-b266-0aafa1ef2012 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1314 microversion: 2.1 time: 0.167316 Feb 21 01:15:40.217020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1099/2378] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:40 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:41.238302 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-34fcc594-fa1c-4006-9339-b767c6b77309 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:41.239532 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-34fcc594-fa1c-4006-9339-b767c6b77309 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:41.250518 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34fcc594-fa1c-4006-9339-b767c6b77309 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.251238 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34fcc594-fa1c-4006-9339-b767c6b77309 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.252528 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34fcc594-fa1c-4006-9339-b767c6b77309 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.253234 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34fcc594-fa1c-4006-9339-b767c6b77309 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.403243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-34fcc594-fa1c-4006-9339-b767c6b77309 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:41.413478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-34fcc594-fa1c-4006-9339-b767c6b77309 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1462 microversion: 2.1 time: 0.182268 Feb 21 01:15:41.414080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1280/2379] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:41 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1462 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:41.452817 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c5ce657e-59a6-4484-bcf7-a25dd489bc7e tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:41.453325 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c5ce657e-59a6-4484-bcf7-a25dd489bc7e tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:41.460114 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5ce657e-59a6-4484-bcf7-a25dd489bc7e tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.460594 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5ce657e-59a6-4484-bcf7-a25dd489bc7e tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.461371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5ce657e-59a6-4484-bcf7-a25dd489bc7e tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.461794 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c5ce657e-59a6-4484-bcf7-a25dd489bc7e tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.489186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c5ce657e-59a6-4484-bcf7-a25dd489bc7e tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:15:41.569748 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c5ce657e-59a6-4484-bcf7-a25dd489bc7e tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 204 len: 0 microversion: 2.1 time: 0.120249 Feb 21 01:15:41.570471 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1100/2380] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:15:41 2022] DELETE /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:15:41.579107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-34ce9827-cd26-4085-aabf-6d9c7dc6bc5f tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:41.579826 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-34ce9827-cd26-4085-aabf-6d9c7dc6bc5f tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:41.586058 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34ce9827-cd26-4085-aabf-6d9c7dc6bc5f tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.586603 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34ce9827-cd26-4085-aabf-6d9c7dc6bc5f tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.587457 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34ce9827-cd26-4085-aabf-6d9c7dc6bc5f tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:41.588147 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-34ce9827-cd26-4085-aabf-6d9c7dc6bc5f tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:41.718179 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-34ce9827-cd26-4085-aabf-6d9c7dc6bc5f tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:41.725954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-34ce9827-cd26-4085-aabf-6d9c7dc6bc5f tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1468 microversion: 2.1 time: 0.151012 Feb 21 01:15:41.726522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1281/2381] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:41 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1468 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:42.749159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-307fdc28-e0f7-43ab-8225-e58264aa4b21 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:42.750496 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-307fdc28-e0f7-43ab-8225-e58264aa4b21 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:42.759144 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-307fdc28-e0f7-43ab-8225-e58264aa4b21 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:42.759586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-307fdc28-e0f7-43ab-8225-e58264aa4b21 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:42.760358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-307fdc28-e0f7-43ab-8225-e58264aa4b21 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:42.760804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-307fdc28-e0f7-43ab-8225-e58264aa4b21 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:42.895303 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-307fdc28-e0f7-43ab-8225-e58264aa4b21 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:42.903239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-307fdc28-e0f7-43ab-8225-e58264aa4b21 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1468 microversion: 2.1 time: 0.162580 Feb 21 01:15:42.903813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1101/2382] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:42 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:43.829718 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-0bfd4164-1458-4c1c-873a-813ecbeabf49 req-9b977ebb-0392-4d50-bfe3-e83ed1b6aec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff3689c5-c50a-4ccc-bd3a-f0731f2042fd", "name": "network-vif-deleted", "tag": "16ba8e07-d908-4318-8fc6-b59ac3121ac5"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:15:43.831227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:15:43.831227 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:15:43.838953 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0bfd4164-1458-4c1c-873a-813ecbeabf49 req-9b977ebb-0392-4d50-bfe3-e83ed1b6aec5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.839401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-0bfd4164-1458-4c1c-873a-813ecbeabf49 req-9b977ebb-0392-4d50-bfe3-e83ed1b6aec5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.850983 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-0bfd4164-1458-4c1c-873a-813ecbeabf49 req-9b977ebb-0392-4d50-bfe3-e83ed1b6aec5 service nova] Creating event network-vif-deleted:16ba8e07-d908-4318-8fc6-b59ac3121ac5 for instance ff3689c5-c50a-4ccc-bd3a-f0731f2042fd on hv-cinder-81322 Feb 21 01:15:43.856771 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-0bfd4164-1458-4c1c-873a-813ecbeabf49 req-9b977ebb-0392-4d50-bfe3-e83ed1b6aec5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030554 Feb 21 01:15:43.857450 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1282/2383] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:15:43.920870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:43.921497 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:43.930311 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.930749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.931586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.932234 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.964245 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:43.964725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:43.965168 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lazy-loading 'fault' on Instance uuid ff3689c5-c50a-4ccc-bd3a-f0731f2042fd {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:15:44.007791 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3745a32e4a2f4cf1a1dcf15d5e11cdbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da1df67d9ea4300b553b80ef7cbb0a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:15:44.019075 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a837b83c-4b31-4efa-87e4-52dd41c24719 tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 200 len: 1304 microversion: 2.1 time: 0.101662 Feb 21 01:15:44.019916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1102/2384] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:43 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:15:45.041692 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:15:45.042471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] [instance: ff3689c5-c50a-4ccc-bd3a-f0731f2042fd] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:15:45.049962 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:45.050463 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:45.051333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:15:45.051809 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:15:45.066815 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] HTTP exception thrown: Instance ff3689c5-c50a-4ccc-bd3a-f0731f2042fd could not be found. Feb 21 01:15:45.067544 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] Returning 404 to user: Instance ff3689c5-c50a-4ccc-bd3a-f0731f2042fd could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:15:45.068370 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-65480a7b-6db1-4400-a571-24caa3629bfd tempest-VolumesNegativeTest-1336306214 tempest-VolumesNegativeTest-1336306214-project] 10.222.0.72 "GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd" status: 404 len: 111 microversion: 2.1 time: 0.032205 Feb 21 01:15:45.068939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1283/2385] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:15:45 2022] GET /compute/v2.1/servers/ff3689c5-c50a-4ccc-bd3a-f0731f2042fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:16:35.348909 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:16:35.349595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:16:52.651469 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:16:52.652247 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:16:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:17:30.373702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:30.374265 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:30.380588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.381039 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.381843 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.382237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.395856 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] HTTP exception thrown: Instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be could not be found. Feb 21 01:17:30.396468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Returning 404 to user: Instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be could not be found. {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:17:30.397290 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-aeb092b2-60f1-40fc-a7bd-9e59c0ae6492 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 404 len: 111 microversion: 2.20 time: 0.028360 Feb 21 01:17:30.397813 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1103/2386] 10.222.0.72 () {60 vars in 1279 bytes} [Mon Feb 21 01:17:30 2022] DELETE /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:17:30.406682 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:30.407312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] [instance: f5aa3b9a-864e-42ff-81ec-278e00ddd8be] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:30.413636 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.414073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.414832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:30.415256 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:30.428912 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] HTTP exception thrown: Instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be could not be found. Feb 21 01:17:30.429489 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] Returning 404 to user: Instance f5aa3b9a-864e-42ff-81ec-278e00ddd8be could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:17:30.430295 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-53a5bd5e-ea0a-4730-a63c-1f4a6f132df6 tempest-AttachVolumeShelveTestJSON-946186765 tempest-AttachVolumeShelveTestJSON-946186765-project] 10.222.0.72 "GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be" status: 404 len: 111 microversion: 2.20 time: 0.028191 Feb 21 01:17:30.430822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1284/2387] 10.222.0.72 () {60 vars in 1276 bytes} [Mon Feb 21 01:17:30 2022] GET /compute/v2.1/servers/f5aa3b9a-864e-42ff-81ec-278e00ddd8be => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:17:35.803632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-383718413", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "ae6c6150-798f-4dd2-a41c-bb8f74ce067e"}]}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:17:35.854753 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.network.neutron [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] validate_networks() for [('ae6c6150-798f-4dd2-a41c-bb8f74ce067e', None, None, None, None, None)] {{(pid=123097) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:17:36.193712 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Flavor limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:17:36.194292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Image limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:17:36.194971 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Flavor pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:17:36.195572 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Image pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:17:36.196154 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:17:36.210098 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:36.210623 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:36.211820 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:36.212450 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:36.231561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Getting quotas for project a510ba6035e54db1bc73586430b91978. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:17:36.235367 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Getting quotas for user 1d0a76b226764239bf2afad929dac8a4 and project a510ba6035e54db1bc73586430b91978. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:17:36.245902 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Going to run 1 instances... {{(pid=123097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:17:36.248155 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:17:36.296222 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-76ce587b-392f-434b-9e43-b931481ce237 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602165 Feb 21 01:17:36.296859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1104/2388] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 01:17:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:17:36.307017 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4d79a089-c875-4ae8-89aa-6b908554d9d6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:36.307691 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4d79a089-c875-4ae8-89aa-6b908554d9d6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:36.362307 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-4d79a089-c875-4ae8-89aa-6b908554d9d6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:36.369080 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4d79a089-c875-4ae8-89aa-6b908554d9d6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1217 microversion: 2.1 time: 0.065925 Feb 21 01:17:36.369638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1285/2389] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:36 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:37.386055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-73f91e4f-2484-4a90-a215-144b834f6ad4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:37.387014 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-73f91e4f-2484-4a90-a215-144b834f6ad4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:37.394030 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73f91e4f-2484-4a90-a215-144b834f6ad4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:37.394472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73f91e4f-2484-4a90-a215-144b834f6ad4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:37.395243 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73f91e4f-2484-4a90-a215-144b834f6ad4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:37.395672 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-73f91e4f-2484-4a90-a215-144b834f6ad4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:37.464545 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-73f91e4f-2484-4a90-a215-144b834f6ad4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:37.473020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-73f91e4f-2484-4a90-a215-144b834f6ad4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1275 microversion: 2.1 time: 0.090594 Feb 21 01:17:37.473624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1105/2390] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:37 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:38.489864 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-616b1bb2-fefe-417e-bf94-a6375c9b6ac4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:38.490482 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-616b1bb2-fefe-417e-bf94-a6375c9b6ac4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:38.498004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-616b1bb2-fefe-417e-bf94-a6375c9b6ac4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.498376 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-616b1bb2-fefe-417e-bf94-a6375c9b6ac4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.499152 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-616b1bb2-fefe-417e-bf94-a6375c9b6ac4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.499586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-616b1bb2-fefe-417e-bf94-a6375c9b6ac4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.530531 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-03e1f421-a010-4435-90c2-ddadf467d3a0 req-0ef67c58-81c6-47f2-b9aa-440aa0ceec25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e988d31a-a9eb-414a-93c8-dbc9184471ab", "tag": "5b4af05d-dd41-4db3-a265-1ec0e3864a31"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:17:38.535145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:17:38.535145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:17:38.549323 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-03e1f421-a010-4435-90c2-ddadf467d3a0 req-0ef67c58-81c6-47f2-b9aa-440aa0ceec25 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:38.549774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-03e1f421-a010-4435-90c2-ddadf467d3a0 req-0ef67c58-81c6-47f2-b9aa-440aa0ceec25 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:38.561469 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-03e1f421-a010-4435-90c2-ddadf467d3a0 req-0ef67c58-81c6-47f2-b9aa-440aa0ceec25 service nova] Creating event network-changed:5b4af05d-dd41-4db3-a265-1ec0e3864a31 for instance e988d31a-a9eb-414a-93c8-dbc9184471ab on hv-cinder-81322 Feb 21 01:17:38.567112 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-03e1f421-a010-4435-90c2-ddadf467d3a0 req-0ef67c58-81c6-47f2-b9aa-440aa0ceec25 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044061 Feb 21 01:17:38.567724 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1106/2391] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:38.645891 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-616b1bb2-fefe-417e-bf94-a6375c9b6ac4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:38.653449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-616b1bb2-fefe-417e-bf94-a6375c9b6ac4 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1317 microversion: 2.1 time: 0.167345 Feb 21 01:17:38.654010 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1286/2392] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:38 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:39.675266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d37baf36-7958-41ce-9979-9846558c6c2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:39.676350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d37baf36-7958-41ce-9979-9846558c6c2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:39.687411 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d37baf36-7958-41ce-9979-9846558c6c2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:39.688269 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d37baf36-7958-41ce-9979-9846558c6c2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:39.689607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d37baf36-7958-41ce-9979-9846558c6c2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:39.690330 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d37baf36-7958-41ce-9979-9846558c6c2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:39.844270 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d37baf36-7958-41ce-9979-9846558c6c2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:39.851700 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d37baf36-7958-41ce-9979-9846558c6c2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1317 microversion: 2.1 time: 0.183468 Feb 21 01:17:39.852266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1107/2393] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:39 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:40.872831 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8630307a-e96b-4a26-ad33-8fc050929c17 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:40.873685 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8630307a-e96b-4a26-ad33-8fc050929c17 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:40.884663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8630307a-e96b-4a26-ad33-8fc050929c17 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:40.885492 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8630307a-e96b-4a26-ad33-8fc050929c17 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:40.887102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8630307a-e96b-4a26-ad33-8fc050929c17 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:40.887828 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8630307a-e96b-4a26-ad33-8fc050929c17 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:41.036408 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-8630307a-e96b-4a26-ad33-8fc050929c17 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:41.045501 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8630307a-e96b-4a26-ad33-8fc050929c17 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1317 microversion: 2.1 time: 0.179222 Feb 21 01:17:41.046077 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1287/2394] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:40 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:42.062968 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fb23a8c8-cad3-404e-87a5-3cdba5f9e7bd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:42.063607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fb23a8c8-cad3-404e-87a5-3cdba5f9e7bd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:42.071024 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb23a8c8-cad3-404e-87a5-3cdba5f9e7bd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:42.071464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb23a8c8-cad3-404e-87a5-3cdba5f9e7bd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:42.072229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb23a8c8-cad3-404e-87a5-3cdba5f9e7bd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:42.072688 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fb23a8c8-cad3-404e-87a5-3cdba5f9e7bd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:42.220332 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fb23a8c8-cad3-404e-87a5-3cdba5f9e7bd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:42.227949 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fb23a8c8-cad3-404e-87a5-3cdba5f9e7bd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1317 microversion: 2.1 time: 0.169707 Feb 21 01:17:42.228532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1108/2395] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:42 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:43.248792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7e934285-c3a8-45bf-8fa7-272c18e7400a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:43.249832 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7e934285-c3a8-45bf-8fa7-272c18e7400a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:43.260379 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7e934285-c3a8-45bf-8fa7-272c18e7400a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:43.261502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7e934285-c3a8-45bf-8fa7-272c18e7400a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:43.262795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7e934285-c3a8-45bf-8fa7-272c18e7400a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:43.263506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7e934285-c3a8-45bf-8fa7-272c18e7400a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:43.416894 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7e934285-c3a8-45bf-8fa7-272c18e7400a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:43.428455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7e934285-c3a8-45bf-8fa7-272c18e7400a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1317 microversion: 2.1 time: 0.185617 Feb 21 01:17:43.429284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1288/2396] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:43 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:43.791904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-e1191646-9a7f-4799-a894-9ce89badd02d req-f73734ad-4507-4c55-bc91-e0d48467db17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e988d31a-a9eb-414a-93c8-dbc9184471ab", "name": "network-vif-plugged", "status": "completed", "tag": "5b4af05d-dd41-4db3-a265-1ec0e3864a31"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:17:43.793484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:17:43.793484 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:17:43.801860 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-e1191646-9a7f-4799-a894-9ce89badd02d req-f73734ad-4507-4c55-bc91-e0d48467db17 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:43.802314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-e1191646-9a7f-4799-a894-9ce89badd02d req-f73734ad-4507-4c55-bc91-e0d48467db17 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:43.813708 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-e1191646-9a7f-4799-a894-9ce89badd02d req-f73734ad-4507-4c55-bc91-e0d48467db17 service nova] Creating event network-vif-plugged:5b4af05d-dd41-4db3-a265-1ec0e3864a31 for instance e988d31a-a9eb-414a-93c8-dbc9184471ab on hv-cinder-81322 Feb 21 01:17:43.818706 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-e1191646-9a7f-4799-a894-9ce89badd02d req-f73734ad-4507-4c55-bc91-e0d48467db17 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030507 Feb 21 01:17:43.819300 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1109/2397] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:44.447313 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-148c8b99-ac78-4bbf-989b-c7c42123d940 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:44.448033 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-148c8b99-ac78-4bbf-989b-c7c42123d940 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:44.456606 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-148c8b99-ac78-4bbf-989b-c7c42123d940 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:44.457189 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-148c8b99-ac78-4bbf-989b-c7c42123d940 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:44.458201 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-148c8b99-ac78-4bbf-989b-c7c42123d940 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:44.458763 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-148c8b99-ac78-4bbf-989b-c7c42123d940 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:44.598380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-148c8b99-ac78-4bbf-989b-c7c42123d940 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:44.606296 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-148c8b99-ac78-4bbf-989b-c7c42123d940 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1317 microversion: 2.1 time: 0.164020 Feb 21 01:17:44.606866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1289/2398] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:44 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:45.630851 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d7e47416-7ff3-489d-9c02-b046e5c034ea tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:45.632045 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d7e47416-7ff3-489d-9c02-b046e5c034ea tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:45.642886 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7e47416-7ff3-489d-9c02-b046e5c034ea tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:45.643668 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7e47416-7ff3-489d-9c02-b046e5c034ea tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:45.645019 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7e47416-7ff3-489d-9c02-b046e5c034ea tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:45.645451 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d7e47416-7ff3-489d-9c02-b046e5c034ea tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:45.779478 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-d7e47416-7ff3-489d-9c02-b046e5c034ea tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:45.786998 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d7e47416-7ff3-489d-9c02-b046e5c034ea tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1507 microversion: 2.1 time: 0.163672 Feb 21 01:17:45.787498 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1110/2399] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:45 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:47.148333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c20ee7a2-ed67-48ba-ba53-c897dfd82676 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaeaf30a-ad9d-4859-909b-cfef21f6595a"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:17:47.149503 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c20ee7a2-ed67-48ba-ba53-c897dfd82676 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:47.156096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c20ee7a2-ed67-48ba-ba53-c897dfd82676 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:47.156566 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c20ee7a2-ed67-48ba-ba53-c897dfd82676 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:47.157331 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c20ee7a2-ed67-48ba-ba53-c897dfd82676 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:47.157754 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c20ee7a2-ed67-48ba-ba53-c897dfd82676 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:47.398538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c20ee7a2-ed67-48ba-ba53-c897dfd82676 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253871 Feb 21 01:17:47.399142 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1290/2400] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 01:17:47 2022] POST /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:17:54.931901 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1641435016", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "ae6c6150-798f-4dd2-a41c-bb8f74ce067e"}]}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:17:54.983744 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.network.neutron [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] validate_networks() for [('ae6c6150-798f-4dd2-a41c-bb8f74ce067e', None, None, None, None, None)] {{(pid=123097) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:17:55.367810 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Flavor limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:17:55.368233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Image limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:17:55.368833 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Flavor pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:17:55.369276 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Image pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:17:55.369981 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:17:55.381220 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:55.381662 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:55.382573 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:55.383001 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:55.400000 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Getting quotas for project a510ba6035e54db1bc73586430b91978. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:17:55.405870 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Getting quotas for user 1d0a76b226764239bf2afad929dac8a4 and project a510ba6035e54db1bc73586430b91978. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:17:55.420803 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Going to run 1 instances... {{(pid=123097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:17:55.423208 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:17:55.477391 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-12b1f23c-8166-4334-b657-190694bc4afa tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549616 Feb 21 01:17:55.478167 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1111/2401] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 01:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:17:55.489055 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-fd1c5473-b269-482f-8246-04c2e9b63be1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:55.489738 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-fd1c5473-b269-482f-8246-04c2e9b63be1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:55.542371 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-fd1c5473-b269-482f-8246-04c2e9b63be1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:55.549449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-fd1c5473-b269-482f-8246-04c2e9b63be1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1218 microversion: 2.1 time: 0.064895 Feb 21 01:17:55.550009 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1291/2402] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:55 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:56.566371 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5da5730e-5e27-4232-a502-2226855b5583 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:56.566942 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5da5730e-5e27-4232-a502-2226855b5583 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:56.619774 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-5da5730e-5e27-4232-a502-2226855b5583 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:56.626895 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5da5730e-5e27-4232-a502-2226855b5583 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1218 microversion: 2.1 time: 0.064268 Feb 21 01:17:56.627464 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1112/2403] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:56 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:57.643210 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3c5c7cd3-3361-4128-b536-3d856276ae70 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:57.643818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3c5c7cd3-3361-4128-b536-3d856276ae70 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:57.696927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3c5c7cd3-3361-4128-b536-3d856276ae70 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:57.703588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3c5c7cd3-3361-4128-b536-3d856276ae70 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1218 microversion: 2.1 time: 0.064193 Feb 21 01:17:57.704208 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1292/2404] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:57 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:58.724445 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ddcda50a-ab21-49c5-b320-16a88c3b435b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:58.725388 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ddcda50a-ab21-49c5-b320-16a88c3b435b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:58.789083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ddcda50a-ab21-49c5-b320-16a88c3b435b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:58.796034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ddcda50a-ab21-49c5-b320-16a88c3b435b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1218 microversion: 2.1 time: 0.078001 Feb 21 01:17:58.796583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1113/2405] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:58 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:17:59.817036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c7b68c63-e202-4942-9522-1f30d305b03c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:17:59.818052 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c7b68c63-e202-4942-9522-1f30d305b03c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:17:59.827502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7b68c63-e202-4942-9522-1f30d305b03c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:59.827943 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7b68c63-e202-4942-9522-1f30d305b03c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:59.828759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7b68c63-e202-4942-9522-1f30d305b03c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:17:59.829193 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c7b68c63-e202-4942-9522-1f30d305b03c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:17:59.902333 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c7b68c63-e202-4942-9522-1f30d305b03c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:17:59.909937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c7b68c63-e202-4942-9522-1f30d305b03c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1222 microversion: 2.1 time: 0.099281 Feb 21 01:17:59.910583 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1293/2406] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:17:59 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:00.929229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-74c5a200-2ca3-4d29-8e6c-9a8143c69d94 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:00.929859 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-74c5a200-2ca3-4d29-8e6c-9a8143c69d94 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:00.936840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-74c5a200-2ca3-4d29-8e6c-9a8143c69d94 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:00.937289 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-74c5a200-2ca3-4d29-8e6c-9a8143c69d94 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:00.938064 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-74c5a200-2ca3-4d29-8e6c-9a8143c69d94 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:00.938491 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-74c5a200-2ca3-4d29-8e6c-9a8143c69d94 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:01.011858 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-74c5a200-2ca3-4d29-8e6c-9a8143c69d94 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:01.019796 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-74c5a200-2ca3-4d29-8e6c-9a8143c69d94 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1276 microversion: 2.1 time: 0.094239 Feb 21 01:18:01.020401 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1114/2407] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:00 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:01.767170 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-61caebde-29db-4dce-b676-a792742c3274 req-ebb2912e-152e-449e-a89f-2183c35563c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5392cc0-6e58-4212-9260-c301fd72c6ea", "tag": "d3c02834-2563-4a1f-a536-bc8b57f9b0b1"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:01.769411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:18:01.769411 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:18:01.776773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-61caebde-29db-4dce-b676-a792742c3274 req-ebb2912e-152e-449e-a89f-2183c35563c5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:01.777327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-61caebde-29db-4dce-b676-a792742c3274 req-ebb2912e-152e-449e-a89f-2183c35563c5 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:01.788954 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-61caebde-29db-4dce-b676-a792742c3274 req-ebb2912e-152e-449e-a89f-2183c35563c5 service nova] Creating event network-changed:d3c02834-2563-4a1f-a536-bc8b57f9b0b1 for instance e5392cc0-6e58-4212-9260-c301fd72c6ea on hv-cinder-81322 Feb 21 01:18:01.793814 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-61caebde-29db-4dce-b676-a792742c3274 req-ebb2912e-152e-449e-a89f-2183c35563c5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030256 Feb 21 01:18:01.794417 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1294/2408] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:02.036539 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-068a4c8b-4cbf-46c7-a63e-93d41349e0ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:02.037109 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-068a4c8b-4cbf-46c7-a63e-93d41349e0ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:02.044020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-068a4c8b-4cbf-46c7-a63e-93d41349e0ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:02.044519 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-068a4c8b-4cbf-46c7-a63e-93d41349e0ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:02.045306 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-068a4c8b-4cbf-46c7-a63e-93d41349e0ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:02.045738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-068a4c8b-4cbf-46c7-a63e-93d41349e0ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:02.236697 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-068a4c8b-4cbf-46c7-a63e-93d41349e0ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:02.244552 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-068a4c8b-4cbf-46c7-a63e-93d41349e0ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1318 microversion: 2.1 time: 0.211709 Feb 21 01:18:02.245130 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1115/2409] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:02 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:03.267305 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e0f4d7b4-0369-4d09-906b-3dcb31da76ec tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:03.268455 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e0f4d7b4-0369-4d09-906b-3dcb31da76ec tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:03.278598 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e0f4d7b4-0369-4d09-906b-3dcb31da76ec tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:03.279036 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e0f4d7b4-0369-4d09-906b-3dcb31da76ec tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:03.279801 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e0f4d7b4-0369-4d09-906b-3dcb31da76ec tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:03.280223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e0f4d7b4-0369-4d09-906b-3dcb31da76ec tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:03.427727 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e0f4d7b4-0369-4d09-906b-3dcb31da76ec tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:03.435524 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e0f4d7b4-0369-4d09-906b-3dcb31da76ec tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1318 microversion: 2.1 time: 0.176092 Feb 21 01:18:03.436196 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1295/2410] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:03 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:04.461500 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-939df117-ae52-4edf-a2db-5bab637a1aa6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:04.462461 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-939df117-ae52-4edf-a2db-5bab637a1aa6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:04.473578 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-939df117-ae52-4edf-a2db-5bab637a1aa6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:04.474309 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-939df117-ae52-4edf-a2db-5bab637a1aa6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:04.475565 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-939df117-ae52-4edf-a2db-5bab637a1aa6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:04.476277 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-939df117-ae52-4edf-a2db-5bab637a1aa6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:04.630391 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-939df117-ae52-4edf-a2db-5bab637a1aa6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:04.638440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-939df117-ae52-4edf-a2db-5bab637a1aa6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1318 microversion: 2.1 time: 0.183139 Feb 21 01:18:04.639002 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1116/2411] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:04 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:05.659013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e4089c06-7c50-47e0-b796-39e8c538474a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:05.659964 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e4089c06-7c50-47e0-b796-39e8c538474a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:05.670561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4089c06-7c50-47e0-b796-39e8c538474a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:05.671299 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4089c06-7c50-47e0-b796-39e8c538474a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:05.672669 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4089c06-7c50-47e0-b796-39e8c538474a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:05.673386 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e4089c06-7c50-47e0-b796-39e8c538474a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:05.813689 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-e4089c06-7c50-47e0-b796-39e8c538474a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:05.821089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e4089c06-7c50-47e0-b796-39e8c538474a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1318 microversion: 2.1 time: 0.168407 Feb 21 01:18:05.821663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1296/2412] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:05 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:06.842065 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a12f11e9-7b2c-42a2-aed9-edd48959b0c9 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:06.842941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a12f11e9-7b2c-42a2-aed9-edd48959b0c9 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:06.853722 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a12f11e9-7b2c-42a2-aed9-edd48959b0c9 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:06.854468 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a12f11e9-7b2c-42a2-aed9-edd48959b0c9 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:06.855743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a12f11e9-7b2c-42a2-aed9-edd48959b0c9 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:06.856492 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a12f11e9-7b2c-42a2-aed9-edd48959b0c9 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:07.014394 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a12f11e9-7b2c-42a2-aed9-edd48959b0c9 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:07.021848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a12f11e9-7b2c-42a2-aed9-edd48959b0c9 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1318 microversion: 2.1 time: 0.186275 Feb 21 01:18:07.022421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1117/2413] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:06 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:07.900475 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-1f8e4500-f937-4037-b0d8-1bf3a4d7f8cb req-5c9ec5a2-b9d0-42d1-ba24-c89b2d3bbce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5392cc0-6e58-4212-9260-c301fd72c6ea", "name": "network-vif-plugged", "status": "completed", "tag": "d3c02834-2563-4a1f-a536-bc8b57f9b0b1"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:07.902141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:18:07.902141 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:18:07.909572 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-1f8e4500-f937-4037-b0d8-1bf3a4d7f8cb req-5c9ec5a2-b9d0-42d1-ba24-c89b2d3bbce8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:07.910037 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-1f8e4500-f937-4037-b0d8-1bf3a4d7f8cb req-5c9ec5a2-b9d0-42d1-ba24-c89b2d3bbce8 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:07.922494 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-1f8e4500-f937-4037-b0d8-1bf3a4d7f8cb req-5c9ec5a2-b9d0-42d1-ba24-c89b2d3bbce8 service nova] Creating event network-vif-plugged:d3c02834-2563-4a1f-a536-bc8b57f9b0b1 for instance e5392cc0-6e58-4212-9260-c301fd72c6ea on hv-cinder-81322 Feb 21 01:18:07.927491 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-1f8e4500-f937-4037-b0d8-1bf3a4d7f8cb req-5c9ec5a2-b9d0-42d1-ba24-c89b2d3bbce8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030783 Feb 21 01:18:07.928354 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1297/2414] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:08.040764 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-9c59528e-2901-4c6d-925c-fe4699c598da tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:08.041399 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-9c59528e-2901-4c6d-925c-fe4699c598da tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:08.048650 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c59528e-2901-4c6d-925c-fe4699c598da tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:08.049102 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c59528e-2901-4c6d-925c-fe4699c598da tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:08.049885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c59528e-2901-4c6d-925c-fe4699c598da tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:08.050319 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-9c59528e-2901-4c6d-925c-fe4699c598da tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:08.229551 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-9c59528e-2901-4c6d-925c-fe4699c598da tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:08.237819 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-9c59528e-2901-4c6d-925c-fe4699c598da tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1318 microversion: 2.1 time: 0.201528 Feb 21 01:18:08.238386 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1118/2415] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:08 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:09.260191 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-624f89eb-9801-4d1f-bf17-b5df3194827f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:09.261804 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-624f89eb-9801-4d1f-bf17-b5df3194827f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:09.272600 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-624f89eb-9801-4d1f-bf17-b5df3194827f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:09.273340 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-624f89eb-9801-4d1f-bf17-b5df3194827f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:09.274614 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-624f89eb-9801-4d1f-bf17-b5df3194827f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:09.275323 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-624f89eb-9801-4d1f-bf17-b5df3194827f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:09.417438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-624f89eb-9801-4d1f-bf17-b5df3194827f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:09.427301 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-624f89eb-9801-4d1f-bf17-b5df3194827f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1318 microversion: 2.1 time: 0.174602 Feb 21 01:18:09.428030 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1298/2416] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:09 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:10.449924 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b4a551f0-9ba2-4c10-be1d-20a87e83565c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:10.450960 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b4a551f0-9ba2-4c10-be1d-20a87e83565c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:10.458800 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4a551f0-9ba2-4c10-be1d-20a87e83565c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.459326 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4a551f0-9ba2-4c10-be1d-20a87e83565c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.460229 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4a551f0-9ba2-4c10-be1d-20a87e83565c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.460769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b4a551f0-9ba2-4c10-be1d-20a87e83565c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.600261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b4a551f0-9ba2-4c10-be1d-20a87e83565c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:10.612561 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b4a551f0-9ba2-4c10-be1d-20a87e83565c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1509 microversion: 2.1 time: 0.168717 Feb 21 01:18:10.613410 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1119/2417] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:10 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:10.635459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaeaf30a-ad9d-4859-909b-cfef21f6595a"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:10.637155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:10.646232 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.647117 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.648067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.648067 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.725266 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] HTTP exception thrown: Invalid volume: volume aaeaf30a-ad9d-4859-909b-cfef21f6595a is already attached to instances: e988d31a-a9eb-414a-93c8-dbc9184471ab Feb 21 01:18:10.725863 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Returning 400 to user: Invalid volume: volume aaeaf30a-ad9d-4859-909b-cfef21f6595a is already attached to instances: e988d31a-a9eb-414a-93c8-dbc9184471ab {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:18:10.726697 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-22726dd1-e31e-42ae-beae-515836b1e569 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097553 Feb 21 01:18:10.727241 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1299/2418] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 01:18:10 2022] POST /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:18:10.790667 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-25f8a863-c1c4-4470-acae-01c8df8efff6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:10.791159 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-25f8a863-c1c4-4470-acae-01c8df8efff6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:10.797387 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25f8a863-c1c4-4470-acae-01c8df8efff6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.797832 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25f8a863-c1c4-4470-acae-01c8df8efff6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.798607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25f8a863-c1c4-4470-acae-01c8df8efff6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.799034 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-25f8a863-c1c4-4470-acae-01c8df8efff6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.883406 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-25f8a863-c1c4-4470-acae-01c8df8efff6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lazy-loading 'services' on Instance uuid e988d31a-a9eb-414a-93c8-dbc9184471ab {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:18:10.967352 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-25f8a863-c1c4-4470-acae-01c8df8efff6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab/os-volume_attachments/aaeaf30a-ad9d-4859-909b-cfef21f6595a" status: 202 len: 0 microversion: 2.1 time: 0.180342 Feb 21 01:18:10.968068 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1120/2419] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 01:18:10 2022] DELETE /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab/os-volume_attachments/aaeaf30a-ad9d-4859-909b-cfef21f6595a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:18:10.977175 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-98584338-95f5-4c34-92cc-7cfdc4ec96ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:10.978096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-98584338-95f5-4c34-92cc-7cfdc4ec96ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:10.984045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98584338-95f5-4c34-92cc-7cfdc4ec96ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.984511 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98584338-95f5-4c34-92cc-7cfdc4ec96ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:10.985290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98584338-95f5-4c34-92cc-7cfdc4ec96ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:10.985732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-98584338-95f5-4c34-92cc-7cfdc4ec96ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:11.017012 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-98584338-95f5-4c34-92cc-7cfdc4ec96ad tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Feb 21 01:18:11.017931 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1300/2420] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:10 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:12.029769 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-68ea764e-1883-4390-9dc2-5aede67b2b89 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:12.030865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-68ea764e-1883-4390-9dc2-5aede67b2b89 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:12.037831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68ea764e-1883-4390-9dc2-5aede67b2b89 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:12.038282 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68ea764e-1883-4390-9dc2-5aede67b2b89 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:12.039065 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68ea764e-1883-4390-9dc2-5aede67b2b89 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:12.039502 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-68ea764e-1883-4390-9dc2-5aede67b2b89 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:12.068866 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-68ea764e-1883-4390-9dc2-5aede67b2b89 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043445 Feb 21 01:18:12.069421 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1121/2421] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:12 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:18:12.175759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1408299004", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "ae6c6150-798f-4dd2-a41c-bb8f74ce067e"}]}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:12.233519 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.network.neutron [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] validate_networks() for [('ae6c6150-798f-4dd2-a41c-bb8f74ce067e', None, None, None, None, None)] {{(pid=123098) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:18:12.645043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Flavor limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:18:12.645467 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Image limits 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:18:12.645939 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Flavor pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:18:12.646348 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Image pref 0:0:0 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:18:12.646759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.virt.hardware [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:18:12.659400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:12.659880 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:12.661101 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:12.661631 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:12.680750 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Getting quotas for project a510ba6035e54db1bc73586430b91978. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:18:12.684740 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.quota [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Getting quotas for user 1d0a76b226764239bf2afad929dac8a4 and project a510ba6035e54db1bc73586430b91978. Resources: {'instances', 'cores', 'ram'} {{(pid=123098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:18:12.695006 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Going to run 1 instances... {{(pid=123098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:18:12.697281 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:18:12.747261 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: ERROR oslo.messaging._drivers.impl_rabbit [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [6e2cc5d3-6aed-4fff-93a0-50bd30980305] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:18:13.759389 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [6e2cc5d3-6aed-4fff-93a0-50bd30980305] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 41296. Feb 21 01:18:13.766602 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-48a069cb-69d4-4da8-85cd-35b6b899a16b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594280 Feb 21 01:18:13.767663 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1301/2422] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 01:18:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:18:13.781919 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1e7ce37a-e161-47c2-a42f-e61b059b57f5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:13.782473 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1e7ce37a-e161-47c2-a42f-e61b059b57f5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:13.835381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1e7ce37a-e161-47c2-a42f-e61b059b57f5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:13.842501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1e7ce37a-e161-47c2-a42f-e61b059b57f5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1218 microversion: 2.1 time: 0.065517 Feb 21 01:18:13.843079 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1122/2423] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:13 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:14.859773 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-f61d3d79-bee3-46e4-8a8a-9f7f7bc523a6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:14.860427 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-f61d3d79-bee3-46e4-8a8a-9f7f7bc523a6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:14.868053 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f61d3d79-bee3-46e4-8a8a-9f7f7bc523a6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:14.868646 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f61d3d79-bee3-46e4-8a8a-9f7f7bc523a6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:14.869822 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f61d3d79-bee3-46e4-8a8a-9f7f7bc523a6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:14.870290 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-f61d3d79-bee3-46e4-8a8a-9f7f7bc523a6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:14.939759 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-f61d3d79-bee3-46e4-8a8a-9f7f7bc523a6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:14.947433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-f61d3d79-bee3-46e4-8a8a-9f7f7bc523a6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1276 microversion: 2.1 time: 0.091743 Feb 21 01:18:14.948018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1302/2424] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:14 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:15.965262 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-fc7e7fa1-dc72-4885-9b9b-1176b3e6cad6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:15.965844 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-fc7e7fa1-dc72-4885-9b9b-1176b3e6cad6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:15.973588 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fc7e7fa1-dc72-4885-9b9b-1176b3e6cad6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:15.974046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fc7e7fa1-dc72-4885-9b9b-1176b3e6cad6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:15.974797 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fc7e7fa1-dc72-4885-9b9b-1176b3e6cad6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:15.975227 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-fc7e7fa1-dc72-4885-9b9b-1176b3e6cad6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:16.227793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-fc7e7fa1-dc72-4885-9b9b-1176b3e6cad6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:16.235673 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-fc7e7fa1-dc72-4885-9b9b-1176b3e6cad6 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1318 microversion: 2.1 time: 0.274471 Feb 21 01:18:16.236239 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1123/2425] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:15 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:16.450940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-d9f03e92-e374-4f9a-a039-db9439163c91 req-79f065e2-f411-43cc-b2bf-3779eb4cf734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22470e44-4ec2-4aa1-b0c1-0511dd118bec", "tag": "d09fa326-d870-407a-a9a6-9eca52a1d7b4"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:16.452586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:18:16.452586 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:18:16.459312 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-d9f03e92-e374-4f9a-a039-db9439163c91 req-79f065e2-f411-43cc-b2bf-3779eb4cf734 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:16.459751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-d9f03e92-e374-4f9a-a039-db9439163c91 req-79f065e2-f411-43cc-b2bf-3779eb4cf734 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:16.470308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-d9f03e92-e374-4f9a-a039-db9439163c91 req-79f065e2-f411-43cc-b2bf-3779eb4cf734 service nova] Creating event network-changed:d09fa326-d870-407a-a9a6-9eca52a1d7b4 for instance 22470e44-4ec2-4aa1-b0c1-0511dd118bec on hv-cinder-81322 Feb 21 01:18:16.475400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-d9f03e92-e374-4f9a-a039-db9439163c91 req-79f065e2-f411-43cc-b2bf-3779eb4cf734 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091786 Feb 21 01:18:16.476128 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1303/2426] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:17.252317 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e90aacb8-df14-4ae4-922f-9b20e419b258 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:17.253065 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e90aacb8-df14-4ae4-922f-9b20e419b258 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:17.259579 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e90aacb8-df14-4ae4-922f-9b20e419b258 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:17.260028 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e90aacb8-df14-4ae4-922f-9b20e419b258 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:17.261212 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e90aacb8-df14-4ae4-922f-9b20e419b258 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:17.261637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e90aacb8-df14-4ae4-922f-9b20e419b258 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:17.403365 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e90aacb8-df14-4ae4-922f-9b20e419b258 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:17.411149 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e90aacb8-df14-4ae4-922f-9b20e419b258 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1318 microversion: 2.1 time: 0.162703 Feb 21 01:18:17.411714 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1124/2427] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:17 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:18.435008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-81780a12-f389-4a6c-b4ea-fcaa421fba5a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:18.436137 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-81780a12-f389-4a6c-b4ea-fcaa421fba5a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:18.447154 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81780a12-f389-4a6c-b4ea-fcaa421fba5a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:18.447876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81780a12-f389-4a6c-b4ea-fcaa421fba5a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:18.449204 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81780a12-f389-4a6c-b4ea-fcaa421fba5a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:18.449923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-81780a12-f389-4a6c-b4ea-fcaa421fba5a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:18.601115 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-81780a12-f389-4a6c-b4ea-fcaa421fba5a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:18.608438 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-81780a12-f389-4a6c-b4ea-fcaa421fba5a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1318 microversion: 2.1 time: 0.180285 Feb 21 01:18:18.609161 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1304/2428] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:18 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:19.625581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-aabab990-e078-433a-a318-d6d5098e261a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:19.626374 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-aabab990-e078-433a-a318-d6d5098e261a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:19.634474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aabab990-e078-433a-a318-d6d5098e261a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:19.634997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aabab990-e078-433a-a318-d6d5098e261a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:19.636278 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aabab990-e078-433a-a318-d6d5098e261a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:19.636834 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-aabab990-e078-433a-a318-d6d5098e261a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:19.748868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:18:19.749140 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec (ip 10.222.0.72) !!! Feb 21 01:18:19.777526 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-aabab990-e078-433a-a318-d6d5098e261a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:19.784906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-aabab990-e078-433a-a318-d6d5098e261a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1318 microversion: 2.1 time: 0.163100 Feb 21 01:18:19.785472 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1125/2429] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:19 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:20.801698 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-593348b4-78c3-4acb-a5dc-0286ecb3a04b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:20.802322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-593348b4-78c3-4acb-a5dc-0286ecb3a04b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:20.809043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-593348b4-78c3-4acb-a5dc-0286ecb3a04b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:20.809486 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-593348b4-78c3-4acb-a5dc-0286ecb3a04b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:20.810257 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-593348b4-78c3-4acb-a5dc-0286ecb3a04b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:20.810686 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-593348b4-78c3-4acb-a5dc-0286ecb3a04b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:20.951776 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-593348b4-78c3-4acb-a5dc-0286ecb3a04b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:20.959448 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-593348b4-78c3-4acb-a5dc-0286ecb3a04b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1318 microversion: 2.1 time: 0.161460 Feb 21 01:18:20.960024 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1305/2430] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:20 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:21.979631 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-a1e31f46-7248-44e4-973a-346f3131adc5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:21.980310 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-a1e31f46-7248-44e4-973a-346f3131adc5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:21.987481 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1e31f46-7248-44e4-973a-346f3131adc5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:21.987935 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-997ce599-15c2-479a-a56c-ce4b6a7cf998 req-fd3aafc2-2434-4b52-a576-da4bf4e9ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22470e44-4ec2-4aa1-b0c1-0511dd118bec", "name": "network-vif-plugged", "status": "completed", "tag": "d09fa326-d870-407a-a9a6-9eca52a1d7b4"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:21.988449 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1e31f46-7248-44e4-973a-346f3131adc5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:21.988954 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1e31f46-7248-44e4-973a-346f3131adc5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:21.989453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-a1e31f46-7248-44e4-973a-346f3131adc5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:21.989907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:18:21.989907 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:18:21.997966 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-997ce599-15c2-479a-a56c-ce4b6a7cf998 req-fd3aafc2-2434-4b52-a576-da4bf4e9ac0f service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:21.998538 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-997ce599-15c2-479a-a56c-ce4b6a7cf998 req-fd3aafc2-2434-4b52-a576-da4bf4e9ac0f service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:22.011327 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-997ce599-15c2-479a-a56c-ce4b6a7cf998 req-fd3aafc2-2434-4b52-a576-da4bf4e9ac0f service nova] Creating event network-vif-plugged:d09fa326-d870-407a-a9a6-9eca52a1d7b4 for instance 22470e44-4ec2-4aa1-b0c1-0511dd118bec on hv-cinder-81322 Feb 21 01:18:22.016937 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-997ce599-15c2-479a-a56c-ce4b6a7cf998 req-fd3aafc2-2434-4b52-a576-da4bf4e9ac0f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033077 Feb 21 01:18:22.018113 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1306/2431] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:22.137011 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-a1e31f46-7248-44e4-973a-346f3131adc5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:22.144640 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-a1e31f46-7248-44e4-973a-346f3131adc5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1318 microversion: 2.1 time: 0.169178 Feb 21 01:18:22.145192 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1126/2432] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:21 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:23.163158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-7199b419-421c-47fd-bf6f-67c1557ce10d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:23.164429 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-7199b419-421c-47fd-bf6f-67c1557ce10d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:23.176313 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7199b419-421c-47fd-bf6f-67c1557ce10d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:23.176784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7199b419-421c-47fd-bf6f-67c1557ce10d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:23.177567 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7199b419-421c-47fd-bf6f-67c1557ce10d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:23.177995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-7199b419-421c-47fd-bf6f-67c1557ce10d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:23.320237 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-7199b419-421c-47fd-bf6f-67c1557ce10d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:23.327958 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-7199b419-421c-47fd-bf6f-67c1557ce10d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1318 microversion: 2.1 time: 0.169989 Feb 21 01:18:23.328553 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1307/2433] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:23 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:24.348743 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-b9768c77-2716-46fa-9ffe-055b48860e96 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:24.349733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-b9768c77-2716-46fa-9ffe-055b48860e96 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:24.360517 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b9768c77-2716-46fa-9ffe-055b48860e96 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:24.360961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b9768c77-2716-46fa-9ffe-055b48860e96 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:24.361725 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b9768c77-2716-46fa-9ffe-055b48860e96 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:24.362152 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-b9768c77-2716-46fa-9ffe-055b48860e96 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:24.507977 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-b9768c77-2716-46fa-9ffe-055b48860e96 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:24.516164 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-b9768c77-2716-46fa-9ffe-055b48860e96 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1508 microversion: 2.1 time: 0.173693 Feb 21 01:18:24.516831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1127/2434] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:24 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:25.859711 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-2e7c261d-f7dc-4896-becb-1145cddc2652 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f2a1248-7a07-440a-a6ca-ee303be02ff9"}} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:25.860816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-2e7c261d-f7dc-4896-becb-1145cddc2652 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:25.867280 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2e7c261d-f7dc-4896-becb-1145cddc2652 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:25.867726 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2e7c261d-f7dc-4896-becb-1145cddc2652 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:25.868522 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2e7c261d-f7dc-4896-becb-1145cddc2652 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:25.868955 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-2e7c261d-f7dc-4896-becb-1145cddc2652 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:26.153508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-2e7c261d-f7dc-4896-becb-1145cddc2652 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297503 Feb 21 01:18:26.154138 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1308/2435] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 01:18:25 2022] POST /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:33.670635 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f2a1248-7a07-440a-a6ca-ee303be02ff9"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:33.671792 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:33.678111 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:33.678583 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:33.679331 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:33.679781 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:33.761741 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.wsgi [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] HTTP exception thrown: Invalid volume: volume 6f2a1248-7a07-440a-a6ca-ee303be02ff9 is already attached to instances: 22470e44-4ec2-4aa1-b0c1-0511dd118bec Feb 21 01:18:33.762350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Returning 400 to user: Invalid volume: volume 6f2a1248-7a07-440a-a6ca-ee303be02ff9 is already attached to instances: 22470e44-4ec2-4aa1-b0c1-0511dd118bec {{(pid=123097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:18:33.763211 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-d5ca726b-da88-43e3-bd73-8ac656e834a3 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096555 Feb 21 01:18:33.763758 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1128/2436] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 01:18:33 2022] POST /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:18:33.828996 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-94be009d-2476-439a-8e2c-f7deaf76fa7d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:33.829543 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-94be009d-2476-439a-8e2c-f7deaf76fa7d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:33.835982 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94be009d-2476-439a-8e2c-f7deaf76fa7d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:33.836433 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94be009d-2476-439a-8e2c-f7deaf76fa7d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:33.837231 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94be009d-2476-439a-8e2c-f7deaf76fa7d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:33.837662 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-94be009d-2476-439a-8e2c-f7deaf76fa7d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:33.914980 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-94be009d-2476-439a-8e2c-f7deaf76fa7d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lazy-loading 'services' on Instance uuid 22470e44-4ec2-4aa1-b0c1-0511dd118bec {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:18:33.991026 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-94be009d-2476-439a-8e2c-f7deaf76fa7d tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments/6f2a1248-7a07-440a-a6ca-ee303be02ff9" status: 202 len: 0 microversion: 2.1 time: 0.166565 Feb 21 01:18:33.991683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1309/2437] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 01:18:33 2022] DELETE /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments/6f2a1248-7a07-440a-a6ca-ee303be02ff9 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:18:34.000089 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-63b880ca-d719-4530-9604-fb8cff16838a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:34.001047 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-63b880ca-d719-4530-9604-fb8cff16838a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:34.007172 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63b880ca-d719-4530-9604-fb8cff16838a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:34.007648 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63b880ca-d719-4530-9604-fb8cff16838a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:34.008474 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63b880ca-d719-4530-9604-fb8cff16838a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:34.008916 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-63b880ca-d719-4530-9604-fb8cff16838a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:34.041060 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-63b880ca-d719-4530-9604-fb8cff16838a tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044855 Feb 21 01:18:34.041624 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1129/2438] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:33 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:35.055018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-8b1e7e45-715c-47de-b3cf-a8fa83cedfd1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:35.056111 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-8b1e7e45-715c-47de-b3cf-a8fa83cedfd1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:35.062870 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b1e7e45-715c-47de-b3cf-a8fa83cedfd1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:35.063309 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b1e7e45-715c-47de-b3cf-a8fa83cedfd1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:35.064087 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b1e7e45-715c-47de-b3cf-a8fa83cedfd1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:35.064561 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-8b1e7e45-715c-47de-b3cf-a8fa83cedfd1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:35.093597 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-8b1e7e45-715c-47de-b3cf-a8fa83cedfd1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044433 Feb 21 01:18:35.094155 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1310/2439] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:35 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:18:35.193264 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-102468932", "imageRef": "08a5bfde-79c6-45c8-aadf-a9a7f847dca7", "flavorRef": "452", "networks": [{"uuid": "ae6c6150-798f-4dd2-a41c-bb8f74ce067e"}]}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:35.243637 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.network.neutron [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] validate_networks() for [('ae6c6150-798f-4dd2-a41c-bb8f74ce067e', None, None, None, None, None)] {{(pid=123097) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:18:35.676751 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Flavor limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:18:35.677315 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Image limits 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:18:35.677785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Flavor pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:18:35.678186 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Image pref 0:0:0 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:18:35.678617 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.virt.hardware [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:18:35.687761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:35.688201 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:35.689017 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:35.689440 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:35.707699 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Getting quotas for project a510ba6035e54db1bc73586430b91978. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:18:35.712433 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.quota [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Getting quotas for user 1d0a76b226764239bf2afad929dac8a4 and project a510ba6035e54db1bc73586430b91978. Resources: {'instances', 'cores', 'ram'} {{(pid=123097) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:18:35.724897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Going to run 1 instances... {{(pid=123097) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:18:35.727236 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='08a5bfde-79c6-45c8-aadf-a9a7f847dca7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123097) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:18:35.776597 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-31f36440-ac48-46aa-b44d-d6760aab1f2e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587219 Feb 21 01:18:35.777243 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1130/2440] 10.222.0.72 () {60 vars in 1146 bytes} [Mon Feb 21 01:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:18:35.786794 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-41659f14-1bae-453d-abbf-dca040b0faf8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:35.787400 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-41659f14-1bae-453d-abbf-dca040b0faf8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:35.840874 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-41659f14-1bae-453d-abbf-dca040b0faf8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:35.847456 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-41659f14-1bae-453d-abbf-dca040b0faf8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1217 microversion: 2.1 time: 0.064332 Feb 21 01:18:35.848029 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1311/2441] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:35 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:36.864293 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-db12cd7a-0c39-40ca-8406-d5ad29eb0d1c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:36.865055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-db12cd7a-0c39-40ca-8406-d5ad29eb0d1c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:36.872065 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-db12cd7a-0c39-40ca-8406-d5ad29eb0d1c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:36.872804 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-db12cd7a-0c39-40ca-8406-d5ad29eb0d1c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:36.873558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-db12cd7a-0c39-40ca-8406-d5ad29eb0d1c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:36.873997 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-db12cd7a-0c39-40ca-8406-d5ad29eb0d1c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:36.946008 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-db12cd7a-0c39-40ca-8406-d5ad29eb0d1c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:36.953487 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-db12cd7a-0c39-40ca-8406-d5ad29eb0d1c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1275 microversion: 2.1 time: 0.093648 Feb 21 01:18:36.954054 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1131/2442] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:36 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:37.970418 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-05a0d3ee-198d-4b93-95db-b9b07fecfeca tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:37.971021 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-05a0d3ee-198d-4b93-95db-b9b07fecfeca tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:37.978424 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05a0d3ee-198d-4b93-95db-b9b07fecfeca tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:37.978866 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05a0d3ee-198d-4b93-95db-b9b07fecfeca tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:37.979638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05a0d3ee-198d-4b93-95db-b9b07fecfeca tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:37.980060 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-05a0d3ee-198d-4b93-95db-b9b07fecfeca tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:38.051397 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-6baedb70-c8bb-4fec-9994-9a4794b7c84a req-7304e9d1-bcee-4e36-8ee9-1d8043704c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa4b4f0-3caf-45b9-9173-5476d42ee803", "tag": "68721529-2c3f-4fb6-b57a-959004578f5b"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:38.053135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:18:38.053135 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:18:38.062593 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-6baedb70-c8bb-4fec-9994-9a4794b7c84a req-7304e9d1-bcee-4e36-8ee9-1d8043704c3c service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:38.063005 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-6baedb70-c8bb-4fec-9994-9a4794b7c84a req-7304e9d1-bcee-4e36-8ee9-1d8043704c3c service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:38.078823 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-6baedb70-c8bb-4fec-9994-9a4794b7c84a req-7304e9d1-bcee-4e36-8ee9-1d8043704c3c service nova] Creating event network-changed:68721529-2c3f-4fb6-b57a-959004578f5b for instance caa4b4f0-3caf-45b9-9173-5476d42ee803 on hv-cinder-81322 Feb 21 01:18:38.085037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-6baedb70-c8bb-4fec-9994-9a4794b7c84a req-7304e9d1-bcee-4e36-8ee9-1d8043704c3c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037085 Feb 21 01:18:38.085959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1132/2443] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:18:38.142574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-05a0d3ee-198d-4b93-95db-b9b07fecfeca tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:38.149934 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-05a0d3ee-198d-4b93-95db-b9b07fecfeca tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1317 microversion: 2.1 time: 0.183252 Feb 21 01:18:38.150500 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1312/2444] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:37 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:39.167237 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-62c3c6f0-77e9-485f-b090-2749a5ce2650 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:39.167928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-62c3c6f0-77e9-485f-b090-2749a5ce2650 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:39.174913 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-62c3c6f0-77e9-485f-b090-2749a5ce2650 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:39.175350 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-62c3c6f0-77e9-485f-b090-2749a5ce2650 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:39.176110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-62c3c6f0-77e9-485f-b090-2749a5ce2650 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:39.176581 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-62c3c6f0-77e9-485f-b090-2749a5ce2650 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:39.312076 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-62c3c6f0-77e9-485f-b090-2749a5ce2650 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:39.324103 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-62c3c6f0-77e9-485f-b090-2749a5ce2650 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1317 microversion: 2.1 time: 0.160594 Feb 21 01:18:39.324756 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1133/2445] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:39 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:40.344460 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-aeed2254-efdc-4bed-8fe5-89a6553717ce tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:40.345441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-aeed2254-efdc-4bed-8fe5-89a6553717ce tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:40.353506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aeed2254-efdc-4bed-8fe5-89a6553717ce tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:40.353940 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aeed2254-efdc-4bed-8fe5-89a6553717ce tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:40.354705 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aeed2254-efdc-4bed-8fe5-89a6553717ce tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:40.355122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-aeed2254-efdc-4bed-8fe5-89a6553717ce tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:40.491963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-aeed2254-efdc-4bed-8fe5-89a6553717ce tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:40.499308 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-aeed2254-efdc-4bed-8fe5-89a6553717ce tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1317 microversion: 2.1 time: 0.161020 Feb 21 01:18:40.499871 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1313/2446] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:40 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:41.520675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1ae82719-8e8a-4017-bf20-e94b6a2a1870 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:41.521430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1ae82719-8e8a-4017-bf20-e94b6a2a1870 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:41.528370 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ae82719-8e8a-4017-bf20-e94b6a2a1870 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:41.528881 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ae82719-8e8a-4017-bf20-e94b6a2a1870 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:41.529703 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ae82719-8e8a-4017-bf20-e94b6a2a1870 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:41.530161 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1ae82719-8e8a-4017-bf20-e94b6a2a1870 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:41.670163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1ae82719-8e8a-4017-bf20-e94b6a2a1870 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:41.677763 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1ae82719-8e8a-4017-bf20-e94b6a2a1870 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1317 microversion: 2.1 time: 0.163383 Feb 21 01:18:41.678307 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1134/2447] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:41 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:42.694478 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-63556c2b-cdd8-437e-b15e-1030bc50e325 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:42.695086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-63556c2b-cdd8-437e-b15e-1030bc50e325 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:42.701523 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-63556c2b-cdd8-437e-b15e-1030bc50e325 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:42.701972 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-63556c2b-cdd8-437e-b15e-1030bc50e325 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:42.702747 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-63556c2b-cdd8-437e-b15e-1030bc50e325 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:42.703185 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-63556c2b-cdd8-437e-b15e-1030bc50e325 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:42.846548 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-63556c2b-cdd8-437e-b15e-1030bc50e325 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:42.854381 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-63556c2b-cdd8-437e-b15e-1030bc50e325 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1317 microversion: 2.1 time: 0.163756 Feb 21 01:18:42.855040 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1314/2448] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:42 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:43.874871 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-3211fddf-29a6-4da5-9cfc-a4a3ae45b5ba tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:43.875877 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-3211fddf-29a6-4da5-9cfc-a4a3ae45b5ba tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:43.886885 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3211fddf-29a6-4da5-9cfc-a4a3ae45b5ba tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:43.887616 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3211fddf-29a6-4da5-9cfc-a4a3ae45b5ba tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:43.888959 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3211fddf-29a6-4da5-9cfc-a4a3ae45b5ba tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:43.889675 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-3211fddf-29a6-4da5-9cfc-a4a3ae45b5ba tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:44.025250 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-3211fddf-29a6-4da5-9cfc-a4a3ae45b5ba tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:44.032928 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-3211fddf-29a6-4da5-9cfc-a4a3ae45b5ba tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1317 microversion: 2.1 time: 0.164230 Feb 21 01:18:44.033495 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1135/2449] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:43 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:44.067579 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-5f75300d-a501-4ff4-a01a-276808d7682c req-5e75b691-92f8-48b4-ae74-b71f90390377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa4b4f0-3caf-45b9-9173-5476d42ee803", "name": "network-vif-plugged", "status": "completed", "tag": "68721529-2c3f-4fb6-b57a-959004578f5b"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:44.069325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:18:44.069325 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:18:44.076608 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-5f75300d-a501-4ff4-a01a-276808d7682c req-5e75b691-92f8-48b4-ae74-b71f90390377 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:44.077109 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-5f75300d-a501-4ff4-a01a-276808d7682c req-5e75b691-92f8-48b4-ae74-b71f90390377 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:44.088563 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-5f75300d-a501-4ff4-a01a-276808d7682c req-5e75b691-92f8-48b4-ae74-b71f90390377 service nova] Creating event network-vif-plugged:68721529-2c3f-4fb6-b57a-959004578f5b for instance caa4b4f0-3caf-45b9-9173-5476d42ee803 on hv-cinder-81322 Feb 21 01:18:44.093554 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-5f75300d-a501-4ff4-a01a-276808d7682c req-5e75b691-92f8-48b4-ae74-b71f90390377 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029872 Feb 21 01:18:44.094146 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1315/2450] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:45.053653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-69104664-832d-4f04-a832-f1915e4fbfa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:45.054600 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-69104664-832d-4f04-a832-f1915e4fbfa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:45.065205 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-69104664-832d-4f04-a832-f1915e4fbfa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:45.065906 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-69104664-832d-4f04-a832-f1915e4fbfa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:45.067150 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-69104664-832d-4f04-a832-f1915e4fbfa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:45.067776 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-69104664-832d-4f04-a832-f1915e4fbfa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:45.211690 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-69104664-832d-4f04-a832-f1915e4fbfa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:45.221175 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-69104664-832d-4f04-a832-f1915e4fbfa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1317 microversion: 2.1 time: 0.173834 Feb 21 01:18:45.221749 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1136/2451] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:45 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:46.244156 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-0d51a4dc-dd62-490c-a79d-5b89eb1d5884 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:46.245018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-0d51a4dc-dd62-490c-a79d-5b89eb1d5884 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:46.252824 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d51a4dc-dd62-490c-a79d-5b89eb1d5884 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:46.253346 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d51a4dc-dd62-490c-a79d-5b89eb1d5884 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:46.254248 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d51a4dc-dd62-490c-a79d-5b89eb1d5884 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:46.254751 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-0d51a4dc-dd62-490c-a79d-5b89eb1d5884 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:46.389677 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-0d51a4dc-dd62-490c-a79d-5b89eb1d5884 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:46.397063 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-0d51a4dc-dd62-490c-a79d-5b89eb1d5884 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1507 microversion: 2.1 time: 0.159374 Feb 21 01:18:46.397638 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1316/2452] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:46 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:47.727499 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-5df6cd31-27f8-4414-b757-f6633b173632 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c3eeebe-2e19-4aab-8c0b-65a9403adc84"}} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:18:47.728586 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-5df6cd31-27f8-4414-b757-f6633b173632 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:47.735107 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5df6cd31-27f8-4414-b757-f6633b173632 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:47.735557 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5df6cd31-27f8-4414-b757-f6633b173632 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:47.736314 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5df6cd31-27f8-4414-b757-f6633b173632 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:47.736779 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-5df6cd31-27f8-4414-b757-f6633b173632 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:47.978961 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-5df6cd31-27f8-4414-b757-f6633b173632 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "POST /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255102 Feb 21 01:18:47.979589 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1137/2453] 10.222.0.72 () {60 vars in 1322 bytes} [Mon Feb 21 01:18:47 2022] POST /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:55.619775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-42c804a8-fccc-410f-b3f7-6d4a77f2f30c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:55.620310 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-42c804a8-fccc-410f-b3f7-6d4a77f2f30c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:55.627102 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42c804a8-fccc-410f-b3f7-6d4a77f2f30c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:55.627547 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42c804a8-fccc-410f-b3f7-6d4a77f2f30c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:55.628284 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42c804a8-fccc-410f-b3f7-6d4a77f2f30c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:55.628784 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-42c804a8-fccc-410f-b3f7-6d4a77f2f30c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:55.710441 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.objects.instance [None req-42c804a8-fccc-410f-b3f7-6d4a77f2f30c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lazy-loading 'services' on Instance uuid caa4b4f0-3caf-45b9-9173-5476d42ee803 {{(pid=123098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:18:55.782732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-42c804a8-fccc-410f-b3f7-6d4a77f2f30c tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803/os-volume_attachments/8c3eeebe-2e19-4aab-8c0b-65a9403adc84" status: 202 len: 0 microversion: 2.1 time: 0.166569 Feb 21 01:18:55.783401 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1317/2454] 10.222.0.72 () {58 vars in 1415 bytes} [Mon Feb 21 01:18:55 2022] DELETE /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803/os-volume_attachments/8c3eeebe-2e19-4aab-8c0b-65a9403adc84 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:18:55.792793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-4a4719eb-b5ae-4e0b-b7f3-c77a6bdf21dd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:55.794138 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-4a4719eb-b5ae-4e0b-b7f3-c77a6bdf21dd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:55.802110 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a4719eb-b5ae-4e0b-b7f3-c77a6bdf21dd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:55.802585 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a4719eb-b5ae-4e0b-b7f3-c77a6bdf21dd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:55.803396 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a4719eb-b5ae-4e0b-b7f3-c77a6bdf21dd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:55.804532 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-4a4719eb-b5ae-4e0b-b7f3-c77a6bdf21dd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:55.834501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-4a4719eb-b5ae-4e0b-b7f3-c77a6bdf21dd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Feb 21 01:18:55.835083 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1138/2455] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:55 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:18:56.851947 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-52c1cf44-ad4a-4b43-a7d5-150de37b175b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:56.853000 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-52c1cf44-ad4a-4b43-a7d5-150de37b175b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:56.859375 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52c1cf44-ad4a-4b43-a7d5-150de37b175b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:56.859818 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52c1cf44-ad4a-4b43-a7d5-150de37b175b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:56.860643 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52c1cf44-ad4a-4b43-a7d5-150de37b175b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:56.861043 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-52c1cf44-ad4a-4b43-a7d5-150de37b175b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:56.890706 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-52c1cf44-ad4a-4b43-a7d5-150de37b175b tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046392 Feb 21 01:18:56.891263 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1318/2456] 10.222.0.72 () {58 vars in 1301 bytes} [Mon Feb 21 01:18:56 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:18:58.095238 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-0d2ba610-d810-4abd-8ed0-e7493f7def6f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:58.095754 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0d2ba610-d810-4abd-8ed0-e7493f7def6f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:58.102453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d2ba610-d810-4abd-8ed0-e7493f7def6f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:58.102897 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d2ba610-d810-4abd-8ed0-e7493f7def6f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:58.103904 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d2ba610-d810-4abd-8ed0-e7493f7def6f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:58.104327 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-0d2ba610-d810-4abd-8ed0-e7493f7def6f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:58.130291 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-0d2ba610-d810-4abd-8ed0-e7493f7def6f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:18:58.214831 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-0d2ba610-d810-4abd-8ed0-e7493f7def6f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 204 len: 0 microversion: 2.1 time: 0.122989 Feb 21 01:18:58.215563 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1139/2457] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:18:58 2022] DELETE /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:18:58.224243 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b7ff06c5-8a9b-4478-895b-6faa74807a34 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:58.225089 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b7ff06c5-8a9b-4478-895b-6faa74807a34 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:58.233941 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7ff06c5-8a9b-4478-895b-6faa74807a34 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:58.234440 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7ff06c5-8a9b-4478-895b-6faa74807a34 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:58.235445 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7ff06c5-8a9b-4478-895b-6faa74807a34 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:58.236045 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b7ff06c5-8a9b-4478-895b-6faa74807a34 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:58.369995 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-b7ff06c5-8a9b-4478-895b-6faa74807a34 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:58.378013 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b7ff06c5-8a9b-4478-895b-6faa74807a34 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1513 microversion: 2.1 time: 0.158081 Feb 21 01:18:58.378588 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1319/2458] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:58 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:18:59.399840 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-05da5b28-d20a-47e0-8d69-e01db38d6496 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:18:59.401058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-05da5b28-d20a-47e0-8d69-e01db38d6496 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:18:59.411615 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05da5b28-d20a-47e0-8d69-e01db38d6496 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:59.412358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05da5b28-d20a-47e0-8d69-e01db38d6496 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:59.413655 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05da5b28-d20a-47e0-8d69-e01db38d6496 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:18:59.414360 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-05da5b28-d20a-47e0-8d69-e01db38d6496 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:18:59.561247 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-05da5b28-d20a-47e0-8d69-e01db38d6496 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:18:59.568785 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-05da5b28-d20a-47e0-8d69-e01db38d6496 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1513 microversion: 2.1 time: 0.175735 Feb 21 01:18:59.569347 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1140/2459] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:18:59 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:00.584967 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-bc89c1b1-0b9e-486e-af55-9cd218f5d5ae tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:00.585574 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-bc89c1b1-0b9e-486e-af55-9cd218f5d5ae tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:00.592228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc89c1b1-0b9e-486e-af55-9cd218f5d5ae tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:00.592708 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc89c1b1-0b9e-486e-af55-9cd218f5d5ae tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:00.593483 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc89c1b1-0b9e-486e-af55-9cd218f5d5ae tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:00.593923 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-bc89c1b1-0b9e-486e-af55-9cd218f5d5ae tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:00.734359 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-bc89c1b1-0b9e-486e-af55-9cd218f5d5ae tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:00.742018 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-bc89c1b1-0b9e-486e-af55-9cd218f5d5ae tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 200 len: 1513 microversion: 2.1 time: 0.160845 Feb 21 01:19:00.742642 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1320/2460] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:00 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:00.906987 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-6d881ae1-11dc-4554-a8bc-8551c52a6f8c req-88578985-a5f3-46dd-97c3-348a87de2b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa4b4f0-3caf-45b9-9173-5476d42ee803", "name": "network-vif-deleted", "tag": "68721529-2c3f-4fb6-b57a-959004578f5b"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:19:00.909430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:19:00.909430 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:19:00.919221 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-6d881ae1-11dc-4554-a8bc-8551c52a6f8c req-88578985-a5f3-46dd-97c3-348a87de2b86 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:00.919839 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-6d881ae1-11dc-4554-a8bc-8551c52a6f8c req-88578985-a5f3-46dd-97c3-348a87de2b86 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:00.931999 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-6d881ae1-11dc-4554-a8bc-8551c52a6f8c req-88578985-a5f3-46dd-97c3-348a87de2b86 service nova] Creating event network-vif-deleted:68721529-2c3f-4fb6-b57a-959004578f5b for instance caa4b4f0-3caf-45b9-9173-5476d42ee803 on hv-cinder-81322 Feb 21 01:19:00.938793 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-6d881ae1-11dc-4554-a8bc-8551c52a6f8c req-88578985-a5f3-46dd-97c3-348a87de2b86 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034696 Feb 21 01:19:00.939403 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1141/2461] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:19:01.762993 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:01.763938 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: caa4b4f0-3caf-45b9-9173-5476d42ee803] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:01.774632 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:01.775431 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:01.776963 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:01.777683 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:01.795650 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] HTTP exception thrown: Instance caa4b4f0-3caf-45b9-9173-5476d42ee803 could not be found. Feb 21 01:19:01.796223 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Returning 404 to user: Instance caa4b4f0-3caf-45b9-9173-5476d42ee803 could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:19:01.797086 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-e801e596-94f6-40de-98a0-2f89a6bca2c5 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803" status: 404 len: 111 microversion: 2.1 time: 0.040870 Feb 21 01:19:01.797604 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1321/2462] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:01 2022] GET /compute/v2.1/servers/caa4b4f0-3caf-45b9-9173-5476d42ee803 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:19:02.938926 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-c2b27d66-0047-4c93-b4ff-cc4e57077134 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:02.939546 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c2b27d66-0047-4c93-b4ff-cc4e57077134 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:02.946392 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2b27d66-0047-4c93-b4ff-cc4e57077134 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:02.946838 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2b27d66-0047-4c93-b4ff-cc4e57077134 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:02.947610 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2b27d66-0047-4c93-b4ff-cc4e57077134 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:02.948037 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-c2b27d66-0047-4c93-b4ff-cc4e57077134 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:02.972635 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-c2b27d66-0047-4c93-b4ff-cc4e57077134 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:19:03.057711 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-c2b27d66-0047-4c93-b4ff-cc4e57077134 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 204 len: 0 microversion: 2.1 time: 0.122527 Feb 21 01:19:03.058466 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1142/2463] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:19:02 2022] DELETE /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:19:03.067845 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-c27207ef-f03b-489c-a490-7cfdde9a4404 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:03.069085 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-c27207ef-f03b-489c-a490-7cfdde9a4404 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:03.075709 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c27207ef-f03b-489c-a490-7cfdde9a4404 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:03.076158 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c27207ef-f03b-489c-a490-7cfdde9a4404 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:03.077001 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c27207ef-f03b-489c-a490-7cfdde9a4404 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:03.077437 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-c27207ef-f03b-489c-a490-7cfdde9a4404 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:03.217876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-c27207ef-f03b-489c-a490-7cfdde9a4404 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:03.226004 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-c27207ef-f03b-489c-a490-7cfdde9a4404 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1514 microversion: 2.1 time: 0.163213 Feb 21 01:19:03.226590 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1322/2464] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:03 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:04.248059 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cdbddbde-b034-42b9-b4a9-fd488a2a4f82 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:04.249246 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cdbddbde-b034-42b9-b4a9-fd488a2a4f82 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:04.260274 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdbddbde-b034-42b9-b4a9-fd488a2a4f82 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:04.261055 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdbddbde-b034-42b9-b4a9-fd488a2a4f82 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:04.262328 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdbddbde-b034-42b9-b4a9-fd488a2a4f82 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:04.263032 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cdbddbde-b034-42b9-b4a9-fd488a2a4f82 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:04.409558 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-cdbddbde-b034-42b9-b4a9-fd488a2a4f82 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:04.417043 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cdbddbde-b034-42b9-b4a9-fd488a2a4f82 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1514 microversion: 2.1 time: 0.175872 Feb 21 01:19:04.417625 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1143/2465] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:04 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:05.433927 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-d409f261-c7d8-4767-ab0c-247900461b90 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:05.434502 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-d409f261-c7d8-4767-ab0c-247900461b90 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:05.440910 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d409f261-c7d8-4767-ab0c-247900461b90 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:05.441347 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d409f261-c7d8-4767-ab0c-247900461b90 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:05.442107 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d409f261-c7d8-4767-ab0c-247900461b90 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:05.442530 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-d409f261-c7d8-4767-ab0c-247900461b90 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:05.511506 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-d409f261-c7d8-4767-ab0c-247900461b90 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:05.530872 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-d409f261-c7d8-4767-ab0c-247900461b90 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 200 len: 1472 microversion: 2.1 time: 0.100194 Feb 21 01:19:05.532322 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1323/2466] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:05 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:05.579209 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [req-e7023259-3581-4cfd-9dde-32fd7d9f2cf0 req-6f6a05bb-0cea-498c-afad-e7dd580225cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22470e44-4ec2-4aa1-b0c1-0511dd118bec", "name": "network-vif-deleted", "tag": "d09fa326-d870-407a-a9a6-9eca52a1d7b4"}]} {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:19:05.580733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:19:05.580733 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: warnings.warn(msg) Feb 21 01:19:05.590163 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-e7023259-3581-4cfd-9dde-32fd7d9f2cf0 req-6f6a05bb-0cea-498c-afad-e7dd580225cb service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:05.590612 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [req-e7023259-3581-4cfd-9dde-32fd7d9f2cf0 req-6f6a05bb-0cea-498c-afad-e7dd580225cb service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:05.601865 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.compute.server_external_events [req-e7023259-3581-4cfd-9dde-32fd7d9f2cf0 req-6f6a05bb-0cea-498c-afad-e7dd580225cb service nova] Creating event network-vif-deleted:d09fa326-d870-407a-a9a6-9eca52a1d7b4 for instance 22470e44-4ec2-4aa1-b0c1-0511dd118bec on hv-cinder-81322 Feb 21 01:19:05.607053 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [req-e7023259-3581-4cfd-9dde-32fd7d9f2cf0 req-6f6a05bb-0cea-498c-afad-e7dd580225cb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031585 Feb 21 01:19:05.608143 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1144/2467] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:19:06.552096 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:06.553136 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: 22470e44-4ec2-4aa1-b0c1-0511dd118bec] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:06.561384 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:06.561819 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:06.562587 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:06.563008 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:06.576449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] HTTP exception thrown: Instance 22470e44-4ec2-4aa1-b0c1-0511dd118bec could not be found. Feb 21 01:19:06.577016 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Returning 404 to user: Instance 22470e44-4ec2-4aa1-b0c1-0511dd118bec could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:19:06.577823 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-6b469f6b-f8c4-475b-bb52-95bd638d8416 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec" status: 404 len: 111 microversion: 2.1 time: 0.031964 Feb 21 01:19:06.578353 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1324/2468] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:06 2022] GET /compute/v2.1/servers/22470e44-4ec2-4aa1-b0c1-0511dd118bec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:19:06.586890 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-019a37a0-53dd-4043-be8a-a37633bdaab1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:06.587479 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-019a37a0-53dd-4043-be8a-a37633bdaab1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:06.594424 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-019a37a0-53dd-4043-be8a-a37633bdaab1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:06.594868 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-019a37a0-53dd-4043-be8a-a37633bdaab1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:06.595644 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-019a37a0-53dd-4043-be8a-a37633bdaab1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:06.596078 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-019a37a0-53dd-4043-be8a-a37633bdaab1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:06.622850 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-019a37a0-53dd-4043-be8a-a37633bdaab1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:19:06.700702 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-019a37a0-53dd-4043-be8a-a37633bdaab1 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 204 len: 0 microversion: 2.1 time: 0.117567 Feb 21 01:19:06.701483 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1145/2469] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:19:06 2022] DELETE /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:19:06.709851 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-92327b0b-4a5e-45fd-bb50-52f9fc1b49cd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:06.710459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-92327b0b-4a5e-45fd-bb50-52f9fc1b49cd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:06.716420 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-92327b0b-4a5e-45fd-bb50-52f9fc1b49cd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:06.716867 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-92327b0b-4a5e-45fd-bb50-52f9fc1b49cd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:06.717621 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-92327b0b-4a5e-45fd-bb50-52f9fc1b49cd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:06.718047 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-92327b0b-4a5e-45fd-bb50-52f9fc1b49cd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:06.859821 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-92327b0b-4a5e-45fd-bb50-52f9fc1b49cd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:06.867508 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-92327b0b-4a5e-45fd-bb50-52f9fc1b49cd tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1515 microversion: 2.1 time: 0.161360 Feb 21 01:19:06.868073 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1325/2470] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:06 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:07.885565 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-ff6fc510-86de-4aa6-8450-62ceb89150ab tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:07.886806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-ff6fc510-86de-4aa6-8450-62ceb89150ab tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:07.894046 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff6fc510-86de-4aa6-8450-62ceb89150ab tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:07.894504 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff6fc510-86de-4aa6-8450-62ceb89150ab tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:07.895233 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff6fc510-86de-4aa6-8450-62ceb89150ab tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:07.895940 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-ff6fc510-86de-4aa6-8450-62ceb89150ab tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:08.095456 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-ff6fc510-86de-4aa6-8450-62ceb89150ab tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:08.103171 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-ff6fc510-86de-4aa6-8450-62ceb89150ab tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1515 microversion: 2.1 time: 0.222114 Feb 21 01:19:08.103718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1146/2471] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:07 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:09.078380 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-adb18820-3020-45bc-a594-64c4b96e5959 req-105ecb97-3cf9-4ebc-a9b4-cad4786c2413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5392cc0-6e58-4212-9260-c301fd72c6ea", "name": "network-vif-deleted", "tag": "d3c02834-2563-4a1f-a536-bc8b57f9b0b1"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:19:09.080578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:19:09.080578 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:19:09.087458 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-adb18820-3020-45bc-a594-64c4b96e5959 req-105ecb97-3cf9-4ebc-a9b4-cad4786c2413 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:09.087965 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-adb18820-3020-45bc-a594-64c4b96e5959 req-105ecb97-3cf9-4ebc-a9b4-cad4786c2413 service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:09.100209 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-adb18820-3020-45bc-a594-64c4b96e5959 req-105ecb97-3cf9-4ebc-a9b4-cad4786c2413 service nova] Creating event network-vif-deleted:d3c02834-2563-4a1f-a536-bc8b57f9b0b1 for instance e5392cc0-6e58-4212-9260-c301fd72c6ea on hv-cinder-81322 Feb 21 01:19:09.105775 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-adb18820-3020-45bc-a594-64c4b96e5959 req-105ecb97-3cf9-4ebc-a9b4-cad4786c2413 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100075 Feb 21 01:19:09.106517 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1326/2472] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:19:09.119501 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:09.120626 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:09.131020 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:09.131503 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:09.135072 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:09.135509 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:09.167848 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:09.168288 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:09.168765 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.objects.instance [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lazy-loading 'fault' on Instance uuid e5392cc0-6e58-4212-9260-c301fd72c6ea {{(pid=123097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:19:09.209828 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:09.217292 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-1b1bd961-83b4-4d38-9dfb-c744a8935364 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 200 len: 1308 microversion: 2.1 time: 0.101593 Feb 21 01:19:09.217857 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1147/2473] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:09 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:10.243704 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:10.244848 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e5392cc0-6e58-4212-9260-c301fd72c6ea] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:10.252961 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:10.253513 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:10.254465 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:10.254994 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:10.271862 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] HTTP exception thrown: Instance e5392cc0-6e58-4212-9260-c301fd72c6ea could not be found. Feb 21 01:19:10.272623 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Returning 404 to user: Instance e5392cc0-6e58-4212-9260-c301fd72c6ea could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:19:10.273630 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-4a072b18-eb6c-4dd0-a04c-379a6d410fa8 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea" status: 404 len: 111 microversion: 2.1 time: 0.037426 Feb 21 01:19:10.274279 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1327/2474] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:10 2022] GET /compute/v2.1/servers/e5392cc0-6e58-4212-9260-c301fd72c6ea => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:19:11.420127 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-cd67ddc0-87de-4b06-8e05-2dfa185c9905 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:11.420653 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cd67ddc0-87de-4b06-8e05-2dfa185c9905 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:11.427339 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cd67ddc0-87de-4b06-8e05-2dfa185c9905 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:11.427789 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cd67ddc0-87de-4b06-8e05-2dfa185c9905 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:11.428595 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cd67ddc0-87de-4b06-8e05-2dfa185c9905 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:11.429041 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-cd67ddc0-87de-4b06-8e05-2dfa185c9905 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:11.453876 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-cd67ddc0-87de-4b06-8e05-2dfa185c9905 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Going to try to terminate instance {{(pid=123097) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:19:11.530918 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-cd67ddc0-87de-4b06-8e05-2dfa185c9905 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 204 len: 0 microversion: 2.1 time: 0.114930 Feb 21 01:19:11.531515 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1148/2475] 10.222.0.72 () {58 vars in 1238 bytes} [Mon Feb 21 01:19:11 2022] DELETE /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:19:11.539527 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-3cc49dea-7924-49db-9742-ca91825f3373 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:11.540129 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-3cc49dea-7924-49db-9742-ca91825f3373 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:11.546898 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3cc49dea-7924-49db-9742-ca91825f3373 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:11.547344 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3cc49dea-7924-49db-9742-ca91825f3373 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:11.548114 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3cc49dea-7924-49db-9742-ca91825f3373 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:11.548576 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-3cc49dea-7924-49db-9742-ca91825f3373 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:11.712273 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.policy [None req-3cc49dea-7924-49db-9742-ca91825f3373 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123098) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:11.720272 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-3cc49dea-7924-49db-9742-ca91825f3373 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1513 microversion: 2.1 time: 0.184593 Feb 21 01:19:11.720883 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1328/2476] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:11 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:12.742358 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-34342a7a-f0aa-4915-bf64-2e230115f276 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:12.743058 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-34342a7a-f0aa-4915-bf64-2e230115f276 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:12.750368 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-34342a7a-f0aa-4915-bf64-2e230115f276 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:12.750806 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-34342a7a-f0aa-4915-bf64-2e230115f276 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:12.751596 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-34342a7a-f0aa-4915-bf64-2e230115f276 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:12.752021 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-34342a7a-f0aa-4915-bf64-2e230115f276 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:12.895893 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-34342a7a-f0aa-4915-bf64-2e230115f276 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:12.906676 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-34342a7a-f0aa-4915-bf64-2e230115f276 tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1513 microversion: 2.1 time: 0.170770 Feb 21 01:19:12.907313 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1149/2477] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:12 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:13.889459 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [req-8a49edd1-0fed-4ed1-86e0-30e40b6f69f0 req-71cec4d2-9327-4f6f-984f-d7a5f2cca73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e988d31a-a9eb-414a-93c8-dbc9184471ab", "name": "network-vif-deleted", "tag": "5b4af05d-dd41-4db3-a265-1ec0e3864a31"}]} {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:19:13.891228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:19:13.891228 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: warnings.warn(msg) Feb 21 01:19:13.899032 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-8a49edd1-0fed-4ed1-86e0-30e40b6f69f0 req-71cec4d2-9327-4f6f-984f-d7a5f2cca73e service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:13.899471 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [req-8a49edd1-0fed-4ed1-86e0-30e40b6f69f0 req-71cec4d2-9327-4f6f-984f-d7a5f2cca73e service nova] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:13.912795 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.compute.server_external_events [req-8a49edd1-0fed-4ed1-86e0-30e40b6f69f0 req-71cec4d2-9327-4f6f-984f-d7a5f2cca73e service nova] Creating event network-vif-deleted:5b4af05d-dd41-4db3-a265-1ec0e3864a31 for instance e988d31a-a9eb-414a-93c8-dbc9184471ab on hv-cinder-81322 Feb 21 01:19:13.917876 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [req-8a49edd1-0fed-4ed1-86e0-30e40b6f69f0 req-71cec4d2-9327-4f6f-984f-d7a5f2cca73e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032084 Feb 21 01:19:13.918568 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1329/2478] 10.222.0.72 () {64 vars in 1317 bytes} [Mon Feb 21 01:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:19:13.926898 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.api.openstack.wsgi [None req-e4e55a84-c749-4414-8dd6-06e8af7cb60e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:13.927632 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.compute.api [None req-e4e55a84-c749-4414-8dd6-06e8af7cb60e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123097) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:13.934299 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e4e55a84-c749-4414-8dd6-06e8af7cb60e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:13.934766 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e4e55a84-c749-4414-8dd6-06e8af7cb60e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:13.935718 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e4e55a84-c749-4414-8dd6-06e8af7cb60e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:13.936214 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG oslo_concurrency.lockutils [None req-e4e55a84-c749-4414-8dd6-06e8af7cb60e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:14.047738 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: DEBUG nova.policy [None req-e4e55a84-c749-4414-8dd6-06e8af7cb60e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0a76b226764239bf2afad929dac8a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a510ba6035e54db1bc73586430b91978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123097) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:19:14.055266 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO nova.api.openstack.requestlog [None req-e4e55a84-c749-4414-8dd6-06e8af7cb60e tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 200 len: 1302 microversion: 2.1 time: 0.132343 Feb 21 01:19:14.055761 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: [pid: 123097|app: 0|req: 1150/2479] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:13 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 1302 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:19:15.076260 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Calling method '>' {{(pid=123098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:19:15.077143 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.compute.api [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] [instance: e988d31a-a9eb-414a-93c8-dbc9184471ab] Fetching instance by UUID {{(pid=123098) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:19:15.084732 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:15.085267 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:15.086172 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:19:15.086678 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG oslo_concurrency.lockutils [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Lock "ada545b6-27f6-4ebc-a627-b9fe2dee4e97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:19:15.102432 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.wsgi [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] HTTP exception thrown: Instance e988d31a-a9eb-414a-93c8-dbc9184471ab could not be found. Feb 21 01:19:15.103122 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: DEBUG nova.api.openstack.wsgi [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] Returning 404 to user: Instance e988d31a-a9eb-414a-93c8-dbc9184471ab could not be found. {{(pid=123098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:19:15.104242 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO nova.api.openstack.requestlog [None req-b011205c-9031-4991-aee9-0c6e0689c29f tempest-AttachVolumeNegativeTest-1810039355 tempest-AttachVolumeNegativeTest-1810039355-project] 10.222.0.72 "GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab" status: 404 len: 111 microversion: 2.1 time: 0.034283 Feb 21 01:19:15.104816 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: [pid: 123098|app: 0|req: 1330/2480] 10.222.0.72 () {58 vars in 1235 bytes} [Mon Feb 21 01:19:15 2022] GET /compute/v2.1/servers/e988d31a-a9eb-414a-93c8-dbc9184471ab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:20:12.664444 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:20:12.665498 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:20:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:21:35.360453 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:21:35.361767 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:21:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:21:39.758607 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:21:39.760145 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:21:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:21:55.067261 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:21:55.068369 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:21:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:21:57.210449 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:21:57.211246 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:21:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:23:31.579178 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:23:31.579792 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:23:32.677812 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:23:32.678914 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:23:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:24:55.371086 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:24:55.371941 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:24:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:24:59.771993 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:24:59.772687 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:24:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:25:15.080381 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:25:15.081183 dv-cinder-813226-6-iscsi devstack@n-api.service[123097]: Mon Feb 21 01:25:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:25:17.223687 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:25:17.224753 dv-cinder-813226-6-iscsi devstack@n-api.service[123098]: Mon Feb 21 01:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!